Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for finding lost objects. In some implementations, a video frame is displayed. An input drawing a shape around an area of the video frame is received. A second video frame is displayed. An indication of the shape in the second video frame is displayed. An input to adjust the shape such that the shape is drawn around a second area is received.

Abstract: Methods, systems, an apparatus, including computer programs encoded on a storage device, for training an image classifier. A method includes receiving an image that includes a depiction of an object; generating a set of poorly localized bounding boxes; and generating a set of accurately localized bounding boxes. The method includes training, at a first learning rate and using the poorly localized bounding boxes, an object classifier to classify the object; and training, at a second learning rate that is lower than the first learning rate, and using the accurately localized bounding boxes, the object classifier to classify the object. The method includes receiving a second image that includes a depiction of an object; and providing, to the trained object classifier, the second image. The method includes receiving an indication that the object classifier classified the object in the second image; and performing one or more actions.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for managing virtual surveillance windows for video surveillance. The methods, systems, and apparatus include actions of obtaining an original video, generating a downscaled video from the original video, detecting a first event at a location from the downscaled video using a first classifier, generating a windowed video from the original video based on the location, detecting a second event from the windowed video, and performing an action in response to detecting the second event.

Abstract: Methods, systems, an apparatus, including computer programs encoded on a storage device, for tracking human movement in video images. A method includes obtaining a first image of a scene captured by a camera; identifying a bounding box around a human detected in the first image; determining a scale amount that corresponds to a size of the bounding box; obtaining a second image of the scene captured by the camera after the first image was captured; and detecting the human in the second image based on both the first image scaled by the scale amount and the second image scaled by the scale amount. Detecting the human in the second image can include identifying a second scaled bounding box around the human detected in the second image scaled by the scale amount.

Abstract: Methods, systems, and apparatus for motion-based human video detection are disclosed. A method includes generating a representation of a difference between two frames of a video; providing, to an object detector, a particular frame of the two frames and the representation of the difference between two frames of the video; receiving an indication that the object detector detected an object in the particular frame; determining that detection of the object in the particular frame was a false positive detection; determining an amount of motion energy where the object was detected in the particular frame; and training the object detector based on penalization of the false positive detection in accordance with the amount of motion energy where the object was detected in the particular frame.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for model co-occurrence object detection. One of the methods includes accessing, for a training image, first data that indicates a detected bounding box for a first object depicted in the training image and a predicted type label, accessing, for the training image, ground truth data for one or more ground truth objects, determining, using the first data and the ground truth data, that i) the detected bounding box represents an object that is not a ground truth object represented by the ground truth data or ii) the predicted type label for the first object does not match a ground truth label for the first object identified by the ground truth data, determining a penalty to adjust the model using a distance between the detected bounding box and the labeled bounding box, and training the model using the penalty.

Abstract: A computer-implemented method includes obtaining a delivery schedule for a property, determining that a portable camera used by a visitor is at the property, determining that the portable camera corresponds to the delivery schedule, in response to determining that the portable camera corresponds to the delivery schedule, providing access to the property, and obtaining a video recorded by the portable camera.

Abstract: Systems and techniques are described for using thermal imaging to configure and/or augment temperature regulation operations within a property. In some implementations, a computing device obtains a thermal image of a region of a property. The thermal image identifies at least a surface within the region. A surface temperature of the surface is determined. An ambient temperature for the region is determined based at least on the surface temperature. The one or more temperature controls for the region are adjusted based at least on the ambient temperature.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for implementing video controlled adjustment of light conditions at a property. A monitoring system obtains video data from a video recording device at the property and uses the video data to determine a location of a person at the property as well as a location of an electronic window treatment at the property. Using the video data, the system identifies an attribute of light entering a window at the property. The system determines an adjustment setting for the electronic window treatment at the property based on the attribute of the light and the location of the person at the property. Based on the adjustment setting, a command is provided to perform a first adjustment action that adjusts the position of the electronic window treatment located at the window.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for location tracking. In some implementations, a corresponding method includes obtaining images of one or more persons within a property; identifying a heartbeat for each person of the one or more persons within the images; identifying a location for each person within the images; receiving a request that indicates a heartbeat signature generated from heartbeats sensed by a device worn by a user; determining that an identified heartbeat of a person of the one or more persons matches the heartbeat signature; in response to determining that the identified heartbeat of the person of the one or more persons matches the heartbeat signature, selecting the person as the user; and in response to selecting the person as the user, providing a response to the request based on a location of the person.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, are described for implementing intelligent seating for wellness monitoring. A system obtains data from a first sensor integrated in an intelligent seating apparatus at a property. The first data indicates a potential abnormal condition of a person at the property. The system determines that the person has an abnormal condition based on the first data corresponding to the person having used the seating apparatus. Based on the abnormal condition, the system provides an indication to a client device of the person to prompt the person to adjust their use of the seating apparatus. The system also obtains visual indications of the abnormal condition, determines the type of abnormal condition afflicting the person, and determines a wellness command with instructions for alleviating the abnormal condition. The wellness command is provided for display on the client device.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for finding lost objects. In some implementations, an unassociated object that appeared in a video from a property is identified. Known entities for the property are identified. A number of times that the known entities appeared in videos from the property is obtained. An order to display the known entities for the property based on a number of times that the known entities appeared in videos from the property are determined. An indication that the unassociated object is associated with a particular entity of the known entities is received. An image of the unassociated object from the video in association with the particular entity of the known entities is stored.

Abstract: Methods and systems including computer programs encoded on a computer storage medium, for obtaining imaging data of a parking lot that includes a set of parking spots, detecting a vehicle enter the parking lot, generating a vehicle recognition model for the vehicle, determining that the vehicle is parked in a parking spot, detecting a customer exit the vehicle, generating a customer recognition model for the customer, determining that the customer has entered a business of one or more businesses affiliated with the parking lot, and providing information related to parking space usage for the parking spot and the business to a user device.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for monitoring of pet feeding. The methods, systems, and apparatus include actions of: obtaining a first reference image of a container corresponding to a full state of the container; obtaining a second reference image of the container corresponding to an empty state of the container; obtaining a sample image of the container; based on the first and second reference images, determining an amount of content in the container from the sample image; and based on the amount of the content being less than a reference amount, notifying a user that the amount of the content is getting low.

Abstract: Methods and apparatus are disclosed for enhancing urban surface model with image data obtained from a satellite image. Three dimensional models of an urban cityscape obtained from digital surface models may comprise surface location information but lack image information associated with the cityscape, such as the color and texture of building facades. The location of the satellite at the time of recording the satellite image interest may be obtained from metadata associated with the satellite image. A 3D model of a cityscape corresponding to the satellite image may be subjected to a transformation operation to determine portions of the 3D model that are viewable from a location corresponding to the location of the satellite when taking the picture. Visible facades buildings of the 3D model ma be identified and mapped to portions of the satellite image which may then be used in rendering 2D images from the 3D model.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for cooperative video surveillance. The methods, systems, and apparatus include actions of determining that a vehicle has arrived at a particular parking spot, determining a view of a property for an onboard camera for the vehicle, providing a detection rule to the vehicle based on the view of the property for the onboard camera for the vehicle, and receiving an image captured by the onboard camera for the vehicle based on satisfaction of the detection rule.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for selecting people for a training set. The methods, systems, and apparatus include actions of: obtaining an image of a user, obtaining an initial training set that includes the image of the user as a positive example and images of a subset of a set of other people as negative examples, training an initial classifier with the images of the initial training set, determining false positive classifications by the initial classifier, selecting people in the set of other people based on the false positive classifications, obtaining an updated training set that includes an image of the user, images of the subset of the set of other people, and images of the people that are selected, and generating an updated classifier with the updated training set.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for canine assisted home monitoring. The methods, systems, and apparatus include actions of: obtaining a reference signal from an animal at a property; determining whether an event occurred at the property corresponding to when the reference signal from the animal was received; in response to a determination that the event occurred at the property corresponding to when the reference signal from the animal was received, determining that the reference signal indicates that the event is likely occurring at the property; obtaining a sample signal from the animal at the property; determining whether the sample signal corresponds to the reference signal; and notifying a user that the event, which was determined to be indicated by the reference signal, is likely occurring again at the property.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating distributed jobs for cameras in a monitored property. The methods, systems, and apparatus include actions of obtaining a request to process a video based on an event detected by a first camera at a monitored property, determining resources likely to be available corresponding to the other cameras at the monitored property, allocating one or more tasks corresponding to processing the video to the other cameras based on the resources likely to be available corresponding to the other cameras, and providing the one or more allocated tasks to the first camera and to the other cameras.

Abstract: A computer-implemented method includes obtaining an image of an area of a property from an augmented reality device, identifying the area of the property based on the image obtained from the augmented reality device, determining that the area of the property corresponds to an event at the property or a configuration of a monitoring system of the property, and providing, in response to determining that the area of the property corresponds to the event or the configuration, information that represents the event or the configuration and that is configured to be displayed on the augmented reality device.