Abstract: Systems and method for processing image content are described. In one embodiment, the method comprises receiving a plurality of captured contents showing same scene as captured by one or more cameras having a different focal length and depth maps and generating a consensus cube by obtaining depth map estimations from said received contents. The visibility of different objects in then analyzed to create a soft visibility cube that provides visibility information about each content. A color cube is then generated by using information from the consensus and soft visibility cube. The color cube is then used to combine different received contents and generate a single image for the plurality of contents received.

Abstract: A method and system are provided for processing image content. In one embodiment the method comprises receiving a plurality of captured contents showing same scene as captured by one or more cameras having a different focal length and depth maps and generating a consensus cube by obtaining depth map estimations from said received contents. The visibility of different objects in then analysed to create a soft visibility cube that provides visibility information about each content. A color cube is then generated by using information from the consensus and soft visibility cube. The color cube is then used to combine different received contents and generate a single image for the plurality of contents received.

Abstract: Example embodiments provide a color filter pattern for a plenoptic sensor. In some embodiments, the plenoptic sensor is a nona-pixel sensor comprising a plurality of microlenses and a respective 3×3 array of color filter pixels under each microlens. The filter pixels have three different colors, and the colors of the color filter pixels are arranged such that each of the sub-aperture images generated from the plenoptic image has an extended Bayer pattern, and such that the pixels of a refocused image generated by adding the sub-aperture images with a disparity value of zero or one receive contributions from three pixels of the first color, three pixels of the second color, and three pixels of the third color.

Abstract: Some embodiments of an apparatus, for example a light-field apparatus, may include a microlens; a color filter system; and two or more plenoptic subpixel sensors, the two or more plenoptic subpixel sensors comprising two or more photodiodes formed in a silicon layer, wherein a pyramid shape is etched in the two or more respective silicon photodiodes formed in the silicon layer.

Abstract: For multi-view video content represented in the MVD (Multi-view+Depth) format, the depth maps may be processed to improve the coherency therebetween. In one implementation, to process a target view based on an input view, pixels of the input view are first projected into the world coordinate system, then into the target view to form a projected view. The texture of the projected view and the texture of the target view are compared. If the difference at a pixel is small, then the depth of the target view at that pixel is adjusted, for example, replaced by the corresponding depth of the projected view. When the multi-view video content is encoded and decoded in a system, depth map processing may be applied in the pre-processing and post-processing modules to improve video compression efficiency and the rendering quality.

Abstract: In one embodiment of the disclosure, it is proposed a method for encoding a matrix of image views obtained from data acquired by a plenoptic camera. The method is remarkable in that it comprises: obtaining at least one reference image view from a combination of at least two image views from said matrix of image views; encoding image views that are different from said at least one reference image view, based on said at least one reference image view.

Abstract: Processing image information associated with a 3D scene can involve obtaining image data associated with at least one layer of the 3D scene; determining at least one phase increment distribution associated with the at least one layer for modifying at the at least one layer an image size associated with the scene; and determining a propagation of an image wave front, corresponding to the at least one layer, to a result layer at a distance from the scene to form a propagated image wave front at the result layer representing a hologram of the scene, wherein determining the propagation includes applying the at least one phase increment distribution associated with the at least one layer to the image wave front at the at least one layer.

Abstract: A device, an apparatus and associated methods are provided. In one embodiment, the method comprises obtaining a multi-plane image (MPI) representation of a three dimensional (3D) scene. The MPI representation includes a plurality of slices of content from the 3D scene, each slice corresponding to a different depth relative to a position of a first virtual camera. Each slice is decomposed into regular tiles; and the orientation of each tile is determined.

Abstract: The present invention generally relates to an apparatus and a method for obtaining a registration error map representing a level of sharpness of an image. Many methods are known which allow determining the position of a camera with respect to an object, based on the knowledge of a 3D model of the object and the intrinsic parameters of the camera. However, regardless of the visual servoing technique used, there is no control in the image space and the object may get out of the camera field of view during servoing. It is proposed to obtain a registration error map relating to an image of the object of interest generated by computing an intersection of a re-focusing surface obtained from a 3D model of said object of interest and a focal stack based on acquired four-dimensional light-field data relating to said object of interest.

Abstract: A method and system are provided for processing image content. In one embodiment the method comprises receiving a plurality of captured contents showing same scene as captured by one or more cameras having a different focal length and depth maps and generating a consensus cube by obtaining depth map estimations from said received contents. The visibility of different objects in then analysed to create a soft visibility cube that provides visibility information about each content. A color cube is then generated by using information from the consensus and soft visibility cube. The color cube is then used to combine different received contents and generate a single image for the plurality of contents received.

Abstract: A device comprising filtering means having a pattern of at least four blocks wherein a second block is located vertical to a first block, a third block is located horizontal to said first block and a fourth block is located vertical to said third block and horizontal to said second block; and means to generate a new image from images captured using said filtered rays.

Abstract: A method for encoding at least one matrix of image views obtained from data acquired by a plenoptic camera is disclosed. Image views of the matrix of image views are partitioned into blocks. For a given image view of the at least one matrix of views, the method includes obtaining at least one block to be encoded and a matching block, wherein a difference between the at least one block to be encoded and the matching block fulfills a block matching criterion; determining a residual block regarding the at least one block to be encoded and the matching block, the determining using modified pixels of the at least one block to be encoded and modified pixels of the matching block according to flux variation parameters associated with a pixel sensor of the plenoptic camera; and encoding the residual block.

Abstract: A method and an apparatus for depth-map estimation between at least two images respectively captured by at least two cameras are disclosed. Extrinsic and intrinsic parameters of the at least two cameras are obtained. Local spatial structure descriptors for each pixel of the at least two images are obtained by transforming a patch of pixels surrounding each pixel, and depth is obtained for at least one pixel of a first image among the at least two images, among at least two depth candidates, each depth candidate being associated with a corresponding pixel in a second image of the at least two images, said corresponding pixel in the second image being determined according to the obtained extrinsic and intrinsic parameters.

Abstract: The present invention generally relates to an apparatus and a method for obtaining a registration error map representing a level of sharpness of an image. Many methods are known which allow determining the position of a camera with respect to an object, based on the knowledge of a 3D model of the object and the intrinsic parameters of the camera. However, regardless of the visual servoing technique used, there is no control in the image space and the object may get out of the camera field of view during servoing. It is proposed to obtain a registration error map relating to an image of the object of interest generated by computing an intersection of a re-focusing surface obtained from a 3D model of said object of interest and a focal stack based on acquired four-dimensional light-field data relating to said object of interest.

Abstract: The disclosure concerns a method for filtering spurious pixels in a depth-map. It is important to filter a depth-map to remove the spurious pixels. One issue when filtering spurious pixels, is to remove them while preserving the boundaries of the real details of the depth-map. A known approach to filter spurious pixels is to use a bi-lateral filter. However, the bi-lateral filter is not efficient to remove the spurious pixels. The proposed solution enables to remove spurious pixels in a depth-map while preserving the sharp edges of the depth-map and smoothing faint details or noise.

Abstract: The present invention generally relates to an apparatus and a method for obtaining a registration error map representing a level of sharpness of an image. Many methods are known which allow determining the position of a camera with respect to an object, based on the knowledge of a 3D model of the object and the intrinsic parameters of the camera. However, regardless of the visual servoing technique used, there is no control in the image space and the object may get out of the camera field of view during servoing. It is proposed to obtain a registration error map relating to an image of the object of interest generated by computing an intersection of a re-focusing surface obtained from a 3D model of said object of interest and a focal stack based on acquired four-dimensional light-field data relating to said object of interest.

Abstract: An apparatus to process a lightfield image of a scene acquired with a lightfield acquisition device comprises means for obtaining a first focal stack and a second focal stack, each comprising images representative of the scene and obtained from a different part of the pixels of the lightfield image. A method of processing the lightfield content is also described.

Abstract: Encoding or decoding a stack of images of a same scene focused at different focalization distances from one image to another can involve encoding or decoding information representing an image of the stack of images, where the image meets an image sharpness criterion, reconstructing the image into a reconstructed image, and encoding or decoding at least one other image of the stack of images by prediction from at least the reconstructed image.

Abstract: A method for creating a pair of stereoscopic images is described. The method includes using at least one lightfield camera which receives respective required camera parameters for a left view and a right view. The required camera parameters define a theoretical stereo image pair to acquire respective actual camera parameters for respective sub aperture images that are generated based on the captured image by the lightfield cameras, to determine a best matching sub aperture image for the left view by comparing the required camera parameter for the left view with the actual camera parameters for the respective sub aperture images, to determine a best matching sub aperture image for right view by comparing the required camera parameter for right view with the actual camera parameters for the respective sub aperture images, and to associate the best matching sub aperture image for left view and the best matching sub aperture image for right view as a pair of stereoscopic images.

Abstract: A method for encoding a current focal stack is disclosed that comprises a set of images focused at a different focalization distance from one image to another. According to present disclosure, the method comprises: —encoding (31) information representing an image of the current focal stack, the image being selected in said current focal stack according to an image sharpness criterion, and reconstructing the image into a reconstructed image; —encoding (32) at least another image of the current focal stack by prediction from at least the reconstructed image.