Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for sensor timing correlation. One of the methods includes obtaining (i) first sensor data from a first sensor and (ii) second sensor data from a second sensor; detecting a representation of an object in both the first sensor data and the second sensor data; determining a predicted physical distance between a first representation of the object in the first sensor data and a second representation of the object in the second sensor data; determining a timing offset between the different sensors using the predicted physical distance between the first representation of the object and the second representation of the object; and adjusting, using the timing offset, subsequent data from the first sensor or the second sensor.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for robot navigation. One of the methods includes obtaining one or more images of an area from a robot; detecting two or more lines within the one or more images; identifying at least two of the two or more lines as vanishing lines; determining, using the vanishing lines, a correction maneuver; and controlling the robot to implement the correction maneuver.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for determining that current data captured at a current location of a drone satisfies localization adjustment criteria; in response to determining that the current data captured at the current location of the drone satisfies the localization adjustment criteria, identifying previously captured image data; determining a previous expected location of the drone based on both an expected change in location of the drone and a first previous location determined from other image data captured before the previously captured image data; determining a location difference between the previous expected location of the drone and a second previous location determined from the previously captured image data; and determining the current location of the drone based on the location difference.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for estimating a robot pose. One of the methods includes the actions of obtaining two or more images captured at two or more locations on a property; detecting feature points at positions within two or more images including first feature points in the first image and second feature points in the second image; comparing the positions of the first feature points in the first image to positions of the second feature points in the second image; obtaining data indicating the two or more locations on the property; comparing the two or more locations; and generating depth data for the feature points for use by a robot navigating the property.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for obtaining a sample Light Detection and Ranging (LIDAR) profile generated by a drone; selecting a reference position based on the sample LIDAR profile; determining a LIDAR profile-based translation and rotation relative to a reference LIDAR profile of the reference position; determining an image-based translation and rotation relative to a reference image of the reference position; determining whether the LIDAR profile-based translation and rotation and the image-based translation and rotation satisfy a similarity threshold; and verifying, using a result of the determination, a predicted position of the drone.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for navigation using planar landmarks. In some implementations, images depicting an area of a property captured by a camera are obtained. Landmarks in the area are identified based on the images. An expected stability for each of the landmarks are determined. A map for the area is generated based on the expected stability for each of the landmarks. The map is transmitted to one or more electronic devices.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for exemplar generation and localization. In some implementations, a method includes obtaining sensor data from a robot traversing a route at a property; determining sampling rates along the route using the sensor data obtained from the robot; selecting images from the sensor data as exemplars for robot localization using the sampling rates along the route; determining that a second robot is in a localization phase at the property; and providing representations of the exemplars for robot localization to the second robot.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for lighting adaptive navigation. In some implementations, map data associated with a property is received. Sensor data is obtained. Based on the map data and the sensor data, a lighting scenario is determined. Based on the lighting scenario, a modification to at least one of the lighting scenario, to a planned navigation path for the robotic device, to settings for a sensor of the robotic device, to a position for a sensor of the robotic device, or to a position of the robotic device is determined. An action is performed by based on the one or more modifications.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for determining that current data captured at a current location of a drone satisfies localization adjustment criteria; in response to determining that the current data captured at the current location of the drone satisfies the localization adjustment criteria, identifying previously captured image data; determining a previous expected location of the drone based on both an expected change in location of the drone and a first previous location determined from other image data captured before the previously captured image data; determining a location difference between the previous expected location of the drone and a second previous location determined from the previously captured image data; and determining the current location of the drone based on the location difference.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for navigation using planar landmarks. In some implementations, images depicting an area of a property captured by a camera are obtained. Landmarks in the area are identified based on the images. An expected stability for each of the landmarks are determined. A map for the area is generated based on the expected stability for each of the landmarks. The map is transmitted to one or more electronic devices.