Abstract: An approach to sensor data is based on scenes. One aspect concerns a computer-implemented method for specifying and obtaining a variety of sensor data and processed sensor data related to a scene. The method incorporates a Scene-based API that uses SceneModes and SceneData. An application requesting sensor data communicates a SceneMode to a group of one or more sensor devices and/or sensor modules via the Scene-based API. The SceneMode determines the SceneData to be captured or provided by the sensor group, which typically includes different types of sensor data related to the Scene and also further processed or analyzed data. The application receives the SceneData from the sensor group via the Scene-based API, with the SceneData organized into SceneShots which are samples of the Scene.

Abstract: A sensor device has a sensor base with a sensor mount, for which different sensor assemblies are attachable to the sensor mount. The sensor base transmits different settings to the sensor assembly via the sensor mount interface. The transmission preferably is wireless, rather than using mechanical connectors. The sensor assembly stores the settings in control registers that determine the settings for the capture of sensor data. In one approach, the sensor base includes an application processor and software executing on the application processor determines the settings. The control registers for the sensor assembly are thus software programmable, allowing different settings to be applied to different samples of sensor data.

Abstract: Security and access control is provided for sensor devices, the data captured by sensor devices, and the results of processing and analyzing that data. In one aspect, SceneData related to a Scene is requested from a sensor-side technology stack and at least some of the SceneData is secured, for example by encryption. Different SceneData can be secured separately and at different levels of security, thus providing fine-grained security of the SceneData. In yet another aspect, data security is implemented by a separate privacy management system. In yet another aspect, sensor devices themselves are secured against external network threats. The sensor device includes an execution environment and a separate network management layer that secures the execution environment against threats from the external network. In one implementation, the sensor device is partitioned into a trusted region and a non-trusted region, and the network security stack is implemented in the trusted region.

Abstract: Security and access control is provided for sensor devices, the data captured by sensor devices, and the results of processing and analyzing that data. In one aspect, SceneData related to a Scene is requested from a sensor-side technology stack and at least some of the SceneData is secured, for example by encryption. Different SceneData can be secured separately and at different levels of security, thus providing fine-grained security of the SceneData. In yet another aspect, data security is implemented by a separate privacy management system. In yet another aspect, sensor devices themselves are secured against external network threats. The sensor device includes an execution environment and a separate network management layer that secures the execution environment against threats from the external network. In one implementation, the sensor device is partitioned into a trusted region and a non-trusted region, and the network security stack is implemented in the trusted region.

Abstract: Data about content of the videos is organized into threads for the videos. The threads also contain video bookmarks. Different data are associated with different video bookmarks. The video bookmarks include a frame of the video that marks a time point in the video corresponding to the associated data. The video bookmarks enabling playback of the video from the marked time point. The threads are stored and published to allow subsequent searching by third parties. The video bookmarks can be shared with the third parties.

Abstract: An approach to sensor data is based on scenes. One aspect concerns a computer-implemented method for specifying and obtaining a variety of sensor data and processed sensor data related to a scene. The method incorporates a Scene-based API that uses SceneModes and SceneData. An application requesting sensor data communicates a SceneMode to a group of one or more sensor devices and/or sensor modules via the Scene-based API. The SceneMode determines the SceneData to be captured or provided by the sensor group, which typically includes different types of sensor data related to the Scene and also further processed or analyzed data. The application receives the SceneData from the sensor group via the Scene-based API, with the SceneData organized into SceneShots which are samples of the Scene.

Abstract: An approach to sensor data is based on scenes. One aspect concerns a computer-implemented method for specifying and obtaining a variety of sensor data and processed sensor data related to a scene. The method incorporates a Scene-based API that uses SceneModes and SceneData. An application requesting sensor data communicates a SceneMode to a group of one or more sensor devices and/or sensor modules via the Scene-based API. The SceneMode determines the SceneData to be captured or provided by the sensor group, which typically includes different types of sensor data related to the Scene and also further processed or analyzed data. The application receives the SceneData from the sensor group via the Scene-based API, with the SceneData organized into SceneShots which are samples of the Scene.

Abstract: A sensor device has a sensor base with a sensor mount, for which different sensor assemblies are attachable to the sensor mount. The sensor base transmits different settings to the sensor assembly via the sensor mount interface. The transmission preferably is wireless, rather than using mechanical connectors. The sensor assembly stores the settings in control registers that determine the settings for the capture of sensor data. In one approach, the sensor base includes an application processor and software executing on the application processor determines the settings. The control registers for the sensor assembly are thus software programmable, allowing different settings to be applied to different samples of sensor data.

Abstract: A sensor device has a sensor base with a sensor mount, for which different sensor assemblies are attachable to the sensor mount. The sensor base transmits different settings to the sensor assembly via the sensor mount interface. The transmission preferably is wireless, rather than using mechanical connectors. The sensor assembly stores the settings in control registers that determine the settings for the capture of sensor data. In one approach, the sensor base includes an application processor and software executing on the application processor determines the settings. The control registers for the sensor assembly are thus software programmable, allowing different settings to be applied to different samples of sensor data.

Abstract: Automated discovery of the relative positioning of a network of cameras that view a physical environment. The automated discovery is based on comparing TimeLines for the cameras. The TimeLines are time-stamped data relating to the camera's view, for example a sequence of time stamps and corresponding images captured by a camera at those time stamps. In one approach, the relative positioning is represented by a proximity graph of nodes connected by edges. The nodes represent spaces in the physical environment, and each edge between two nodes represents a pathway between the spaces represented by the two nodes.

Abstract: Data about content of the videos is organized into threads for the videos. The threads also contain video bookmarks. Different data are associated with different video bookmarks. The video bookmarks include a frame of the video that marks a time point in the video corresponding to the associated data. The video bookmarks enabling playback of the video from the marked time point. The threads are stored and published to allow subsequent searching by third parties. The video bookmarks can be shared with the third parties.

Abstract: Security and access control is provided for sensor devices, the data captured by sensor devices, and the results of processing and analyzing that data. In one aspect, SceneData related to a Scene is requested from a sensor-side technology stack and at least some of the SceneData is secured, for example by encryption. Different SceneData can be secured separately and at different levels of security, thus providing fine-grained security of the SceneData. In yet another aspect, data security is implemented by a separate privacy management system. In yet another aspect, sensor devices themselves are secured against external network threats. The sensor device includes an execution environment and a separate network management layer that secures the execution environment against threats from the external network. In one implementation, the sensor device is partitioned into a trusted region and a non-trusted region, and the network security stack is implemented in the trusted region.

Abstract: Members of a social network service may share real-time comments about multimedia content they are viewing. The comments are attached to bookmarks that allow other members to view the video and add to the discussion thread.

Abstract: A sensor device has a sensor base with a sensor mount, for which different sensor assemblies are attachable to the sensor mount. The sensor base transmits different settings to the sensor assembly via the sensor mount interface. The transmission preferably is wireless, rather than using mechanical connectors. The sensor assembly stores the settings in control registers that determine the settings for the capture of sensor data. In one approach, the sensor base includes an application processor and software executing on the application processor determines the settings. The control registers for the sensor assembly are thus software programmable, allowing different settings to be applied to different samples of sensor data.

Abstract: An approach to sensor data is based on scenes. One aspect concerns a computer-implemented method for specifying and obtaining a variety of sensor data and processed sensor data related to a scene. The method incorporates a Scene-based API that uses SceneModes and SceneData. An application requesting sensor data communicates a SceneMode to a group of one or more sensor devices and/or sensor modules via the Scene-based API. The SceneMode determines the SceneData to be captured or provided by the sensor group, which typically includes different types of sensor data related to the Scene and also further processed or analyzed data. The application receives the SceneData from the sensor group via the Scene-based API, with the SceneData organized into SceneShots which are samples of the Scene.

Abstract: The present disclosure overcomes the limitations of the prior art by providing approaches to marking points of interest in scenes. In one aspect, a Scene of interest is identified based on SceneData provided by a sensor-side technology stack that includes a group of one or more sensor devices. The SceneData is based on a plurality of different types of sensor data captured by the sensor group, and typically requires additional processing and/or analysis of the captured sensor data. A SceneMark marks the Scene of interest or possibly a point of interest within the Scene.

Abstract: The present disclosure overcomes the limitations of the prior art by providing 3D compression (i.e., compression that also accounts for changes in depth), including 3D compression of video sequences. In one aspect, depth information is obtained by processing captured images from a multi-aperture imaging device. The availability of IR images and depth information facilitates additional processing compared to when only color images are available.

Abstract: A multi-aperture imaging system determines depth map information. A series of image frames of a scene are captured. The frames include a normal image frame and at least one structured image frame. The multi-aperture imaging system determines edge information of an object in the scene using a deblur technique and the normal image frame. The multi-aperture imaging system determines fill depth information for the object based in part on the at least one structured image frame. The multi-aperture imaging system generates a depth map of the scene using the edge depth information and the fill depth information.

Abstract: The present disclosure overcomes the limitations of the prior art by providing 3D compression (i.e., compression that also accounts for changes in depth), including 3D compression of video sequences. In one aspect, depth information is obtained by processing captured images from a multi-aperture imaging device. The availability of IR images and depth information facilitates additional processing compared to when only color images are available.

Abstract: An image sensor includes both visible pixels and infrared pixels. The visible pixels produce signals indicative of light within a visible band received by the visible pixels, and the infrared pixels produce signals indicative of light within an infrared band received by the infrared pixels. A selective infrared (SIR) filter array is integrated on the image sensor. The SIR filter array includes SIR pixel filters that are positioned to filter out light within the infrared band propagating to the visible pixels. In this way, infrared crosstalk to the visible pixels can be reduced.