Abstract: An approach to sensor data is based on scenes. One aspect concerns a computer-implemented method for specifying and obtaining a variety of sensor data and processed sensor data related to a scene. The method incorporates a Scene-based API that uses SceneModes and SceneData. An application requesting sensor data communicates a SceneMode to a group of one or more sensor devices and/or sensor modules via the Scene-based API. The SceneMode determines the SceneData to be captured or provided by the sensor group, which typically includes different types of sensor data related to the Scene and also further processed or analyzed data. The application receives the SceneData from the sensor group via the Scene-based API, with the SceneData organized into SceneShots which are samples of the Scene.

Abstract: The present disclosure overcomes the limitations of the prior art by providing approaches to marking points of interest in scenes. In one aspect, a Scene of interest is identified based on SceneData provided by a sensor-side technology stack that includes a group of one or more sensor devices. The SceneData is based on a plurality of different types of sensor data captured by the sensor group, and typically requires additional processing and/or analysis of the captured sensor data. A SceneMark marks the Scene of interest or possibly a point of interest within the Scene.

Abstract: There is described a challenge-response method for a computing device. The method comprises steps of: (a) receiving challenge data at a secured module of the computing device, the challenge data comprising image content encrypted using an encryption key, and the image content including a nonce; (b) the secured module recovering the image content through decryption using one or more keys associated with the encryption key; (c) the secured module of the computing device outputting the recovered image content; (d) capturing the image content as output by the secured module; (e) processing the captured image content so as to obtain the nonce; and (f) providing the nonce as a response. There is also described a computing device arranged to carry out the challenge-response method, a computer program for causing a processor to carry out the challenge-response method, and a computer readable medium storing such a computer program.

Abstract: There is described a challenge-response method for a client device. The method comprises steps of: (a) receiving challenge data, wherein the challenge data is content encrypted using an encryption key, the content including a nonce; (b) using a secured module of the client device to access the content by decrypting the challenge data using a decryption key of the secured module, the decryption key corresponding to the encryption key; (c) processing a version of the content output by the secured module so as to obtain the nonce; and (d) providing the nonce as a response. There is also described a client device for implementing the above challenge-response method. There is also described a computer program which, when executed by a processor, causes the processor to carry out the above challenge-response method. Finally, there is described a computer readable medium storing the above-mentioned computer program.

Abstract: The present disclosure overcomes the limitations of the prior art by providing 3D compression (i.e., compression that also accounts for changes in depth), including 3D compression of video sequences. In one aspect, depth information is obtained by processing captured images from a multi-aperture imaging device. The availability of IR images and depth information facilitates additional processing compared to when only color images are available.

Abstract: A computer-implemented method for a gesture-based user interface and a gesture-based user interface system are described. The method comprises receiving image data from a multi-aperture image sensor in said electronic device, said image sensor being configured to simultaneously expose an image sensor to at least a first part of the electromagnetic (EM) spectrum using a first aperture and at least a second part of the EM spectrum using one or more second apertures; determining sharpness information in at least one area of said image data associated with at least part of an object imaged by said first aperture and said one or more second apertures onto the image plane of said image sensor; generating depth information on the basis of at least part of said sharpness information; and, recognizing on the basis of said depth information, at least part of a gesture associated with a movement of said object.

Abstract: There is described a method for a first software application to access a secured software application on a computing device. The first software application is not configured to interface with the secured software application. The computing device includes an interfacing application configured to interface with the secured software application. The method comprises the first software application interfacing with the interfacing application to thereby cause the interfacing application to access the secured software application. The first software application is configured to interface with the interfacing application. There is also described a method of generating an encrypted version of an image using a library of pre-encrypted blocks of data, the same content encryption key having been used to encrypt each of the pre-encrypted blocks of data.

Abstract: A multi-aperture imaging system determines depth map information. A series of image frames of a scene are captured. The frames include a normal image frame and at least one structured image frame. The multi-aperture imaging system determines edge information of an object in the scene using a deblur technique and the normal image frame. The multi-aperture imaging system determines fill depth information for the object based in part on the at least one structured image frame. The multi-aperture imaging system generates a depth map of the scene using the edge depth information and the fill depth information.

Abstract: The invention relates to a method and system for watermarking in a content providing system having multiple parties. A first party system selects a first party watermark by selecting a watermarked copy of at least one first content element of the content elements. A second party system selects a second party watermark by selecting a watermarked copy of at least one second content element, different from the at least one first content element, of the content elements. Watermarked content is delivered to an end user device, the watermarked content containing the watermarked copy for the first content element selected by the first party system and the watermarked copy for the second content element selected by the second party system such that the watermarked content contains the first party watermark and the second party watermark.

Abstract: The invention provides for a solution enabling obtaining a control word in the client. The client device has a unique binary identification. An input transformed control word is mapped from an input transform domain to an output transform domain to thereby obtain an output transformed control word by successively applying a transformation function to the input transformed control word using each compound of seeds from the set successively as an input to the successive transformation functions. Each of the successive transformation functions is one of a regular transformation function, a first special transformation function and a second special transformation function. The obtained control word can be used to decrypt one of two copies of a part of content data. The copy that can be decrypted contains a watermark representing either a binary “0” or a binary “1” and represents a bit of the unique binary identification of the client device.

Abstract: A method and a system for forming an image of a scene are provided. The method includes capturing an image of the scene by exposing an image sensor to radiation from one part of the EM spectrum using one aperture and to radiation from another part of the EM spectrum using another aperture having a different size than the first aperture. Simultaneously with capturing the image, the scene is illuminated with radiation from the second part of the EM spectrum. The image is then formed on the basis of image data generated by the radiation from the first part of the EM spectrum and image data generated by radiation from the second part of the EM spectrum.

Abstract: The present disclosure overcomes the limitations of the prior art by providing 3D compression (i.e., compression that also accounts for changes in depth), including 3D compression of video sequences. In one aspect, depth information is obtained by processing captured images from a multi-aperture imaging device. The availability of IR images and depth information facilitates additional processing compared to when only color images are available.

Abstract: An image sensor includes both visible pixels and infrared pixels. The visible pixels produce signals indicative of light within a visible band received by the visible pixels, and the infrared pixels produce signals indicative of light within an infrared band received by the infrared pixels. A selective infrared (SIR) filter array is integrated on the image sensor. The SIR filter array includes SIR pixel filters that are positioned to filter out light within the infrared band propagating to the visible pixels. In this way, infrared crosstalk to the visible pixels can be reduced.

Abstract: There is disclosed a head-end system in which differently processed copies of content portions are reordered such that copies from different content portions are not interleaved in the final transport stream.

Abstract: A method and a system for processing multi-aperture image data are described, wherein the method comprises: capturing image data associated with one or more objects by simultaneously exposing an image sensor in an imaging system to spectral energy associated with at least a first part of the electromagnetic spectrum using at least a first aperture and to spectral energy associated with at least a second part of the electromagnetic spectrum using at least a second and third aperture; generating first image data associated with said first part of the electromagnetic spectrum and second image data associated with said second part of the electromagnetic spectrum; and, generating depth information associated with said captured image on the basis displacement information in said second image data, preferably on the basis of displacement information in an auto-correlation function of the high-frequency image data associated with said second image data.

Abstract: A compound multi-aperture imaging system includes multiple multi-aperture imaging systems, preferably with overlapping fields of view. In one aspect, each multi-aperture imaging system includes an optical imaging system with two apertures, for example an aperture for the visible wavelength region and a smaller aperture for the infrared wavelength region. An image sensor captures both visible and infrared images. These can be processed to obtain depth information. The visible images can also be stitched together to produce a larger composite image.

Abstract: An application programming interface (API) provides access to a multi-aperture imaging system. By using the API, higher level applications can access and/or specify the image capture by the multi-aperture imaging device. For example, the API can support the specification of various image capture parameters: resolution, frame rate, exposure, flash, filtering, and additional processing to be applied. These could be specified for all frames and all channels (Red, Green, Blue and Infrared), or could be specified for specific subframes within a frame and/or for specific channels. The API can also specify output data from the multi-aperture imaging device. This can include raw pixel data, image data (color and Infrared), depth maps, and other processed image data. It can also include metadata and data about the status of the multi-aperture imaging device.

Abstract: The invention provides a system and a method for securely providing a secret data from a sender to one or more receivers. The receiver uses a sequence of functions originating from a hierarchy of functions to migrate the secret data from an input transform space to an output transform space using a mathematical transformation under control of one or more seeds. The seeds are provided to the receiver by the sender. The sender conditionally allows the receiver to obtain the secret data by controlling the seeds.

Abstract: A multi-aperture imaging system determines depth map information. First raw image data associated with a first image of a scene is captured using a first imaging system characterized by a first point spread function (PSF). Second raw image data associated with a second image of the scene is captured using a second imaging system characterized by a second PSF that varies as a function of depth differently than the first point spread function. High-frequency image data is generated using the first raw image data and the second raw image data. Edges are identified using normalized derivative values of the high-frequency image data, and edge depth information is determined for the identified edges using a bank of blur kernels. Fill depth information is determined for image components other than the identified edges, and a depth map of the scene is generated using the edge depth information and the fill depth information.

Abstract: There is disclosed a head-end system in which differently processed copies of content portions are reordered such that copies from different content portions are not interleaved in the final transport stream.