Abstract: Methods and devices for generated multiplane images from a representation of a 3D scene are disclosed. When an MPI is generated by the system, an image of the accumulation of the alpha values is computed. A convolutional networked is trained with a penalization function that penalizes MPIs with high values of accumulated alpha according to a parameter selected or trained to reduce the redundancy of information between layers of the MPI. When generating a MPI from a subset of the views of a new captured 3D scene, a first MPI is generated with the trained CNN with the associated parameter. An error is calculated between the other views and corresponding synthesized with the first MPI. This error is used to modify the parameter. Then, a second MPI is generated with the trained CNN with the new parameter.

Abstract: An apparatus and method for processing a light field comprising a plurality of views of a 3D scene includes obtaining a super-ray representation for the light field, wherein the super-ray representation comprises a plurality of super-rays, wherein each super-ray groups pixels corresponding to a set of light rays having a similar color from each of the plurality of views, and wherein the set of light rays for each super-ray originates from one area of the 3D scene; and processing the light field by processing the super-ray representation for the light field, wherein processing the light field comprises at least one of editing the light field, segmenting the light field, and refocusing the light field.

Abstract: The present disclosure concerns a method for processing a light field image comprising a set of image views.

Abstract: A device comprising filtering means having a pattern of at least four blocks wherein a second block is located vertical to a first block, a third block is located horizontal to said first block and a fourth block is located vertical to said third block and horizontal to said second block; and means to generate a new image from images captured using said filtered rays.

Abstract: A method is proposed for estimating a depth for pixels in a matrix of M images. Such method comprises, at least for one set of N images among the M images, 2<N?M, a process comprising: —determining depth maps for the images in the set of N images delivering a set of N depth maps; —for at least one current pixel for which a depth has not yet been estimated: —deciding if a candidate depth corresponding to a depth value in the set of N depth maps is consistent or not with the other depth map(s) of the set of N depth maps; —selecting the candidate depth as being the estimated depth for the current pixel if the candidate depth is decided as consistent. The process is enforced iteratively with a new N value which is lower than the previous N value used in the previous iteration of the process.

Abstract: A method and device for processing a light field video is described. The light field video includes a set of image views per unit of time, the light field video being associated with a scene without cuts. In the method a first super-rays representation of reference image views at a given time is determined based on centroids. A second super-rays representation associated with corresponding views of a subsequent set of image views is next determined based on de-projection and re-projection of centroids. The displacement of centroids between the first and second super-rays is determined and then the determined displacement is applied to centroids of the second super-rays representation.

Abstract: A method is proposed for estimating a depth for pixels in a matrix of M images. Such method comprises, at least for one set of N images among the M images, 2?N?M, a process comprising: —determining depth maps for the images in the set of N images delivering a set of N depth maps; —for at least one current pixel for which a depth has not yet been estimated: —deciding if a candidate depth corresponding to a depth value in the set of N depth maps is consistent or not with the other depth map(s) of the set of N depth maps; —selecting the candidate depth as being the estimated depth for the current pixel if the candidate depth is decided as consistent. The process is enforced iteratively with a new N value which is lower than the previous N value used in the previous iteration of the process.

Abstract: The present disclosure concerns a method for processing a light field image comprising a set of image views.

Abstract: The present disclosure concerns a method for processing a light field image comprising a set of image views.

Abstract: A device comprising filtering means having a pattern of at least four blocks wherein a second block is located vertical to a first block, a third block is located horizontal to said first block and a fourth block is located vertical to said third block and horizontal to said second block; and means to generate a new image from images captured using said filtered rays.

Abstract: A method for rendering an image, called a final image, from at least one image acquired by a camera array, is provided. According to such a method, the determination of a color value for at least one pixel of the final image, called a current pixel, comprises: for at least one initial image acquired by the camera array, obtaining a color value of a pixel associated with said current pixel within said at least one initial image, acquiring at least one color value called a real color value; computing at least one interpolated color value, from said at least one real color value; determining the color value for said current pixel, as a function of said at least one real color value and said at least one interpolated color value.

Abstract: The invention describes a method for applying a geometric warp to the light field capture of a 3D scene, consisting of several views of the scene taken from different viewpoints. The warp is specified as a set of (source point, target point) positional constraints on a subset of the views. These positional constraints are propagated to all the views and a warped image is generated for each view, in such a way that these warped images are geometrically consistent in 3D across the views.

Abstract: The disclosure concerns a method for filtering spurious pixels in a depth-map. It is important to filter a depth-map to remove the spurious pixels. One issue when filtering spurious pixels, is to remove them while preserving the boundaries of the real details of the depth-map. A known approach to filter spurious pixels is to use a bi-lateral filter. However, the bi-lateral filter is not efficient to remove the spurious pixels. The proposed solution enables to remove spurious pixels in a depth-map while preserving the sharp edges of the depth-map and smoothing faint details or noise.

Abstract: A method and an apparatus for data retrieval in a lightfield database are described. An acquiring unit of the apparatus acquires a sample data. An operation unit determines a plurality of two-dimensional (2D) images from each 4D lightfield data of the lightfield database, and match the sample data with the determined 2D images according to geometrical parameters of the sample data and geometrical parameters of the 2D images. One of the 2D images is selected as a target image based on the matching result, and the 4D lightfield from which the target image is determined is retrieved.

Abstract: A method and device for processing a light field video is described. The light field video includes a set of image views per unit of time, the light field video being associated with a scene without cuts. In the method a first super-rays representation of reference image views at a given time is determined based on centroids. A second super-rays representation associated with corresponding views of a subsequent set of image views is next determined based on de-projection and re-projection of centroids. The displacement of centroids between the first and second super-rays is determined and then the determined displacement is applied to centroids of the second super-rays representation.

Abstract: Selecting at least one surface in a light field, such as a light field associated with multiple views corresponding to different view points of a same scene, may include displaying one of the multiple views as a reference view, selecting at least one surface in the reference view, identifying a set of pixels belonging to the selected surface, which are occluded in the reference view but visible in at least one of the multiple views, projecting the set of pixels into the reference view on the basis of a value of the pixels of the set in the view or views in which they are visible in order to form an upgraded reference view, displaying the upgraded reference view, and updating the selected surface in the upgraded reference view.

Abstract: In one embodiment, it is proposed a method for obtaining at least one sub-aperture image being associated with one view, from raw light field data corresponding to recorded data by an array of pixels sensors positioned behind an array of micro-lenses in a light field camera, each of said pixel sensor recording a linear mixing of up to four different views. The method is remarkable in that it comprises applying a signal separation process on said raw data by using an inverse of a mixing matrix A, said mixing matrix comprising coefficients that convey weighting information of said up to four different views recorded by a pixel sensor.

Abstract: A method and an apparatus for data retrieval in a lightfield database are described. An acquiring unit of the apparatus acquires a sample data. An operation unit determines a plurality of two-dimensional (2D) images from each 4D lightfield data of the lightfield database, and match the sample data with the determined 2D images according to geometrical parameters of the sample data and geometrical parameters of the 2D images. One of the 2D images is selected as a target image based on the matching result, and the 4D lightfield from which the target image is determined is retrieved.

Abstract: An apparatus to process a lightfield image of a scene acquired with a lightfield acquisition device comprises means for obtaining a first focal stack and a second focal stack, each comprising images representative of the scene and obtained from a different part of the pixels of the lightfield image. A method of processing the lightfield content is also described.

Abstract: The present disclosure concerns a method for processing a light field image comprising a set of image views.