Abstract: Devices, systems and methods are disclosed for improving a playback of video data and generation of a video summary. For example, annotation data may be generated for individual video frames included in the video data to indicate content present in the individual video frames, such as faces, objects, pets, speech or the like. A video summary may be determined by calculating a priority metric for individual video frames based on the annotation data. In response to input indicating a face and a period of time, a video summary can be generated including video segments focused on the face within the period of time. The video summary may be directed to multiple faces and/or objects based on the annotation data.

Abstract: Systems and methods for tracking inventory are provided herein. In some embodiments, a method for tracking inventory includes receiving weight sensor data representing a weight of a physical item in the storage unit, adding the weight of the physical item to a profile corresponding to the physical item, determining that the weight of the physical item is less than a predetermined threshold weight associated with the physical item, generating notification information associated with the physical item, and sending the notification information. In some embodiments, a method for tracking inventory includes receiving sensor data representing a location of a physical item, adding the location of the physical item to a profile corresponding to the physical item, receiving audio data representing a request for the location of the physical item, retrieving the location of the physical item from the profile, generating responsive data representing the of the physical item, and sending the responsive data.

Abstract: This application describes techniques for controlling an apparatus that includes a camera both locally and remotely. The camera apparatuses described herein may include obfuscation components that function to selectively obfuscate a view of the camera at the request of a user. For instance, one particular camera apparatus may include a lens cap and an actuator to move the lens cap from a position in which the lens cap at least partially obfuscates the view of the camera to a position in which the lens cap does not (and vice versa). The camera apparatus may include a physical control to allow a user to locally request to open or close the lens cap, and may also include a network interface to communicate with a user device, thus allowing a user to remotely request to open or close the lens cap.

Abstract: Systems and methods for tracking inventory are provided herein. In some embodiments, a method for tracking inventory includes receiving weight sensor data representing a weight of an item in the storage unit, adding the weight of the item to a profile corresponding to the item, determining that the weight of the item is less than a predetermined threshold weight associated with the item, generating notification information associated with the item, and sending the notification information. In some embodiments, a method for tracking inventory includes receiving sensor data representing a location of an item, adding the location of the item to a profile corresponding to the item, receiving audio data representing a request for the location of the item, retrieving the location of the item from the profile, generating responsive data representing the of the item, and sending the responsive data.

Abstract: Systems, methods, and computer-readable media are disclosed for detecting handwritten text on a writing surface, determining one or more layout and/or content attributes of the handwritten text, determining application functionality that corresponds to the layout and/or content attribute(s), executing the application functionality to obtain an execution result, and presenting an indication of the execution result on the writing surface in association with at least a portion of the handwritten text.

Abstract: This application describes techniques for controlling an apparatus that includes a camera both locally and remotely. The camera apparatuses described herein may include obfuscation components that function to selectively obfuscate a view of the camera at the request of a user. For instance, one particular camera apparatus may include a lens cap and an actuator to move the lens cap from a position in which the lens cap at least partially obfuscates the view of the camera to a position in which the lens cap does not (and vice versa). The camera apparatus may include a physical control to allow a user to locally request to open or close the lens cap, and may also include a network interface to communicate with a user device, thus allowing a user to remotely request to open or close the lens cap.

Abstract: Devices, systems and methods are disclosed for improving a playback of video data and generation of a video summary. For example, annotation data may be generated for individual video frames included in the video data to indicate content present in the individual video frames, such as faces, objects, pets, speech or the like. A video summary may be determined by calculating a priority metric for individual video frames based on the annotation data. In response to input indicating a face and a period of time, a video summary can be generated including video segments focused on the face within the period of time. The video summary may be directed to multiple faces and/or objects based on the annotation data.

Abstract: Devices, systems and methods are disclosed for generating video tags associated with previously captured video data. During a recording mode, video data may be captured and uploaded to a server. In response to a command, video may be tagged and selected, for example for inclusion in a video summary. During a standby mode, video data may be captured and temporarily stored in a buffer. In response to the command, video data stored in the buffer prior to the command may be selected. The video data may be selected for further processing and/or uploaded to the server.

Abstract: A system and method is provided for generating an edit decision list used to render a video summarization. The system may determine a structure indicating a pacing and a sequence of video clips included in the video summarization. The system may determine weighted priority metrics for a plurality of video clips, may identify first video clips having a weighted priority metric above a first threshold and may include the first video clips in the video summarization. The system may determine similarity scores for the plurality of video clips, identify second video clips having a weighted priority metric below the first threshold but above a second threshold and a similarity score below a third threshold and may include a portion of the second video clips in the video summarization. The system may determine layouts, apply special effects and transitions and synchronize music with the video summarization based on a theme and annotation data.

Abstract: This application describes techniques for controlling an apparatus that includes a camera both locally and remotely. The camera apparatuses described herein may include obfuscation components that function to selectively obfuscate a view of the camera at the request of a user. For instance, one particular camera apparatus may include a lens cap and an actuator to move the lens cap from a position in which the lens cap at least partially obfuscates the view of the camera to a position in which the lens cap does not (and vice versa). The camera apparatus may include a physical control to allow a user to locally request to open or close the lens cap, and may also include a network interface to communicate with a user device, thus allowing a user to remotely request to open or close the lens cap.

Abstract: A system and method for generating a short video summary from video data. For example, the system may receive input video data including video clips and may select snippets from each video clip to include in the short video summary. To select a snippet, the system may calculate a priority metric for individual frames in a video clip, may generate a priority metric graph for the video clip and may select a portion of the video clip associated with a peak of the priority metric graph. Thus, the snippets may include a short duration of time (e.g., 1-4 seconds) corresponding to the peak of the priority metric graph. The system may reorder the snippets based on characteristics of content represented in the snippet.

Abstract: Devices, systems and methods are disclosed for allowing multiple devices to generate tags associated with video data captured by a single device. For example, a recording device may capture and upload video data and the multiple devices may generate tags identifying memorable moments. The tags may be used to generate a video summary, such as a single video summary for the captured video data that includes video data associated with tags generated by multiple devices. In addition, the tags may be associated with unique devices and may be used to generate multiple video summaries. For example, the tags may be used to generate individual video summaries for each of the multiple devices. Therefore, multiple devices may tag the captured video data to generate the single video summary and/or multiple individual video summaries.

Abstract: Devices, systems and methods are disclosed for improving a playback of video data and generation of a video summary. For example, annotation data may be generated for individual video frames included in the video data to indicate content present in the individual video frames, such as faces, objects, pets, speech or the like. A video summary may be determined by calculating a priority metric for individual video frames based on the annotation data. In response to input indicating a face and a period of time, a video summary can be generated including video segments focused on the face within the period of time. The video summary may be directed to multiple faces and/or objects based on the annotation data.

Abstract: Devices, systems and methods are disclosed for smoothing rendering data (e.g., panning data and/or magnification data) prior to rendering a video clip. The rendering data may be recorded using a first sampling rate and the system may determine Bézier points using a second sampling rate. The Bézier points may be aligned with the rendering data and may be used to generate smoothed rendering data. The smoothed rendering data may be used to render a video clip that may be displayed to a user. If the user inputs additional rendering data during playback of the video clip, the system may generate second smoothed rendering data. For example, the system may record additional rendering data for a second half of the video clip and generate second smoothed rendering data, including a first half of the first smoothed rendering data, based on the additional rendering data.

Abstract: Various examples are directed to systems and method for creating a summary video of user content comprising a plurality of frames of data. A summarization engine may identify from the user content a first region-of-interest and a second region-of-interest. The summarization engine may generate a first content clip that comprises the first region-of-interest and has a first time length. The summarization engine may receive a new input variable for the summary video. The summarization engine may determine a modified first time length of the first content clip and generate a modified first content clip having the first modified time length. The summarization engine may generate the summary video including the modified first content clip.

Abstract: Speech-controlled searching and browsing for content using speech-controlled devices, or other input-limited devices, is described. A user may audibly indicate to a speech-controlled device whether the user wants to search or browse for content, along with a topic of the content/results to be retrieved. A server, located remotely from the speech-controlled device determines an appropriate endpoint device for displaying results of the requested search or browse. The server also determines an appropriate content source for the requested content, and sends a request for the content to the content source. The server receives search or browse results from the content source and forwards them to the determined endpoint device.

Abstract: Devices, systems and methods are disclosed for improving a display of panoramic video data by including an angle indicator as a visual representation of a direction of a displayed portion of the panoramic video data relative to a reference location. For example, the angle indicator may illustrate an angle of the displayed portion of the video data relative to a front of the video capture device, using 360 degrees, and the user of the device may specify a desired angle and/or desired portion of the video data to display. In addition, the device may generate video tags including angle information based on the user input. For example, the device may determine the desired angle and/or desired portion of the video data to display and may generate a video tag associating the angle with a timestamp and/or video frame.

Abstract: Devices, systems and methods are disclosed for improving a display of panoramic video data by including a first angle indicator, as a visual representation of a direction of a displayed portion of the panoramic video data relative to a reference location, along with a second angle indicator indicating an object of interest. The second angle indicator may display a fixed angle or a recommended angle to improve navigation within the panoramic video data. The fixed angle may be determined by the user or the device and may remain stationary during playback of the panoramic video data, allowing the user to switch between directional views without panning. The recommended angle may be determined based on a location of a tracked object, allowing the user to display the tracked object without panning. The second angle indicator may be represented by an icon illustrating the object of interest.

Abstract: A system and method for generating a short video summary from video data. For example, the system may receive input video data including video clips and may select snippets from each video clip to include in the short video summary. To select a snippet, the system may calculate a priority metric for individual frames in a video clip, may generate a priority metric graph for the video clip and may select a portion of the video clip associated with a peak of the priority metric graph. Thus, the snippets may include a short duration of time (e.g., 1-4 seconds) corresponding to the peak of the priority metric graph. The system may reorder the snippets based on characteristics of content represented in the snippet.