Abstract: Methods, systems, and apparatus for ground plane filtering of video events are disclosed. A method includes obtaining a first set of images of a scene from a camera; determining a ground plane from the first set of images of the scene; obtaining a second set of images of the scene after the first set of images of the scene is obtained; determining that movement shown by a group of pixels in the second set of images of the scene satisfies motion criteria; determining that the ground plane corresponds with at least a portion of the group of pixels; and in response to determining that movement shown by the group of pixels in the second set of images of the scene satisfies motion criteria, and that the ground plane corresponds with at least a portion of the group of pixels, classifying the group of pixels as showing ground plane based motion.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for generating rules for a monitoring system. In some implementations, a method includes presenting a virtual model of a monitoring system of a property; obtaining action data from a computer generated avatar in the virtual model; generating a security rule for the monitoring system using the action data from the computer generated avatar in the virtual model; and providing, to the monitoring system, the security rule to cause the monitoring system to generate, using the security rule and sensor data from the property received by the monitoring system, a security alert.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for generating a placement of a camera. In some implementations, maintaining monitoring information of a property; generating a virtual model of a property; determining an initial placement location for a virtual camera in the virtual model; obtaining image data generated in the virtual model from the virtual camera placed at the initial placement location; analyzing the image data; determining, using the analysis of the image data, whether to identify an updated placement location; and providing the placement location for a physical camera at the property to a device using a result of the determination whether to identify the updated placement location.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for estimating a robot pose. One of the methods includes the actions of obtaining two or more images captured at two or more locations on a property; detecting feature points at positions within two or more images including first feature points in the first image and second feature points in the second image; comparing the positions of the first feature points in the first image to positions of the second feature points in the second image; obtaining data indicating the two or more locations on the property; comparing the two or more locations; and generating depth data for the feature points for use by a robot navigating the property.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for reducing a likelihood that a doorbell might be used. One of the methods includes determining that a visitor arrived at a premises; determining that the visitor used a computing device at a first time; determining that a user device of a person of the premises received a message at a second time; determining that the first time and the second time both satisfy a timing criteria; and in response to determining that the first time and the second time both satisfy the timing criteria, sending, to the user device, a notification that indicates that the visitor arrived at the premises.

Abstract: Methods, systems, and apparatus for video analytics evaluation are disclosed. A method includes: identifying a video to display a result of an evaluation of video analysis; identifying a particular time in the video when a video analysis determination does not match a ground truth determination for the video; displaying an image from the particular time in the video; and displaying an indication that the video analysis determination does not match the ground truth determination for the video. Displaying the image from the particular time in the video can include generating a graphical user interface for presentation on a display of a computing device. The indication that the video analysis determination does not match the ground truth determination for the video can include a user-selectable icon. In response to a user selecting the user-selectable icon, the method can include displaying video analysis results for the particular time in the video.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for managing alerts based on predicted user activity. In some implementations, a request is received to send an alert to a target device of a target user. A status of the target user is determined. One or more properties of the alert are determined. Using at least the status of the target user and the one or more properties of the alert, the alert is presented on the target device according to a determined delay from a first time period during which the alert would normally be presented to a second, later time period.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for obtaining a sample Light Detection and Ranging (LIDAR) profile generated by a drone; selecting a reference position based on the sample LIDAR profile; determining a LIDAR profile-based translation and rotation relative to a reference LIDAR profile of the reference position; determining an image-based translation and rotation relative to a reference image of the reference position; determining whether the LIDAR profile-based translation and rotation and the image-based translation and rotation satisfy a similarity threshold; and verifying, using a result of the determination, a predicted position of the drone.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, are described for implementing intelligent seating for wellness monitoring. A system obtains data from a first sensor integrated in an intelligent seating apparatus at a property. The first data indicates a potential abnormal condition of a person at the property. The system determines that the person has an abnormal condition based on the first data corresponding to the person having used the seating apparatus. Based on the abnormal condition, the system provides an indication to a client device of the person to prompt the person to adjust their use of the seating apparatus. The system also obtains visual indications of the abnormal condition, determines the type of abnormal condition afflicting the person, and determines a wellness command with instructions for alleviating the abnormal condition. The wellness command is provided for display on the client device.

Abstract: Methods, systems, and apparatus for ground plane filtering of video events are disclosed. A method includes obtaining a first set of images of a scene from a camera; determining a ground plane from the first set of images of the scene; obtaining a second set of images of the scene after the first set of images of the scene is obtained; determining that movement shown by a group of pixels in the second set of images of the scene satisfies motion criteria; determining that the ground plane corresponds with at least a portion of the group of pixels; and in response to determining that movement shown by the group of pixels in the second set of images of the scene satisfies motion criteria, and that the ground plane corresponds with at least a portion of the group of pixels, classifying the group of pixels as showing ground plane based motion.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for integrating a monitoring system with one or more air quality sensors. The method includes obtaining a request that includes an indication of an appearance of an object, selecting a first set of images in an initial modality based on the indication of the appearance of the object, determining an additional set of images in a different modality based on mappings between the first set of images and the additional set of images; and providing the first set of images and the additional set of images in response to the request.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for automated package management. One of the methods includes for an image that depicts a package at a property and a person retrieving the package, determining, using data from the image or from a device for the person, whether the person is authorized to retrieve the package; and in response to determining that the person is authorized to retrieve the package, determining to skip performing an automated action that would have been performed if the person was not authorized to retrieve the package.

Abstract: Methods, systems, and apparatus for drone-assisted sensor mapping are disclosed. A method includes detecting a sensor in a detection area of a drone; based on detecting the sensor in the detection area of the drone, detecting the drone in sensor data captured by the sensor; determining a detection area of the sensor based on movement of the drone after the drone is detected; and determining a destination for the drone based on the detection area of the sensor. The method may include mapping boundaries of the detection area of the sensor to a map of an area where the sensor is located. The sensor can be a passive infrared sensor, an active infrared sensor, a radar sensor, a sonar sensor, a time of flight sensor, a structured light sensor, or a lidar sensor.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for assistive robotic manipulation of building controls. In some implementations, a method includes obtaining sensor data from a property at a first time; obtaining sensor data from the property at a second time; determining whether the sensor data from the first time and the second time satisfy a criteria; in response to determining the criteria is satisfied, generating a mapping between an interface and a device; and providing the mapping to a robot for activating the device.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for performing assistive actions using predictive human behavior. One of the methods includes obtaining a the first image of a person within a first threshold distance of a property; predicting, using the first image of the person, a task flow including a sequence of activities to be performed by the person; obtaining a second image of the person within a second threshold distance of the property; determining, using the second image, that activities performed by the person do not match the task flow; and in response to determining that the activities performed by the person do not match the predicted task flow, performing one or more actions at the property.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for selectively obfuscating audio. One of the methods includes detecting, by a security system for a premises, that a person who was within a threshold area for the premises was likely uttering a sound; determining, using data from one or more sensors, a likelihood that the person was communicating with the security system at the premises; determining whether the likelihood satisfies a threshold likelihood and that the person's voice should not be obfuscated; and in response to determining whether the likelihood satisfies the threshold likelihood and that the person's voice should not be obfuscated, selectively obfuscating the person's voice or maintaining, in memory, an audio signal i) that encodes the person's voice and ii) was captured by a microphone that was physically located at the premises.

Abstract: Methods, systems, and apparatus for remote camera-assisted robot guidance are disclosed. A method includes obtaining images of objects approaching a door of a property; identifying candidate paths to the door based on the images of the objects approaching the door of the property; determining movement capabilities of the objects; storing the candidate paths to the door labeled by the movement capabilities of the objects that took the paths; determining capability information for a robot at the property that indicates movement capabilities of the robot; selecting, from the candidate paths, a path for the robot to take to the door based on the movement capabilities of the robot and the labels of the candidate paths; and providing guidance information to the robot that guides the robot to the door along the selected path.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for adjusting of video analytics rules for camera movement. The methods, systems, and apparatus include actions of obtaining a rule that specifies a first set of coordinates applied to a first set of images from a camera, determining an amount and direction of movement of the camera after the rule was obtained, determining, based on the amount and direction of movement of the camera, a second set of coordinates applied to a second set of images captured after the camera moved.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for monitoring extended reality spaces. One of the methods includes selecting, from a physical space at a property, a first available portion of the physical space for representing an extended reality environment; causing presentation of a first portion of the extended reality environment at the first available portion of the physical space; predicting, using sensor data generated from one or more sensors at the property, that the first available portion of the physical space will likely be interfered with; in response to predicting that the first available portion of the physical space will likely be interfered with, selecting, from the plurality of available portions of the physical space, a second available portion for representing the environment; and causing presentation of a second portion of the extended reality environment at the second available portion of the physical space.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for monitoring extended reality spaces. One of the methods includes determining, for a first extended reality environment generated by a first device, first data defining a first three-dimensional space at a property for the first environment; determining, for a second extended reality environment generated by a second device, second data defining a second three-dimensional space at the property for the second environment; determining whether the first space at least partially overlaps with the second space; in response to determining that the first space at least partially overlaps with the second space, determining that the first space has a higher priority than the second space; in response to determining that the first space has the higher priority than the second space, providing, to the second device, a command to adjust an experience for the second extended reality environment.