Abstract: Methods and apparatus for estimating a depth of unfocused plenoptic data are suggested. The method includes: determining a level of homogeneity of micro-lens images of unfocused plenoptic data; determining pixels of the micro-lens images of the unfocused plenoptic unfocused plenoptic data which either have disparities equal to zero or belong to homogeneous areas as a function of the calculated level of homogeneity of the micro-lens images of the unfocused plenoptic data; and estimating the depth of the unfocused plenoptic data by a disparity estimation without considering the determined pixels. With the disclosure, by pre-processing the raw data, it can prevent any disparity estimation method to spend time on estimating disparities for: (i) pixels that are in focus, (ii) pixels that belong to homogenous areas of the scene.

Abstract: A method for rendering an image, called a final image, from at least one image acquired by a camera array, is provided. According to such a method, the determination of a color value for at least one pixel of the final image, called a current pixel, comprises: for at least one initial image acquired by the camera array, obtaining a color value of a pixel associated with said current pixel within said at least one initial image, acquiring at least one color value called a real color value; computing at least one interpolated color value, from said at least one real color value; determining the color value for said current pixel, as a function of said at least one real color value and said at least one interpolated color value.

Abstract: A method and an apparatus for displaying light field video data are described. A receiving unit of the apparatus receives light field video data including a plurality of light field video sequences. Each light field video frames of of the light field video sequences has multiple selectable viewpoints. A light field video frame is provided by an operation unit and displayed on a display device with a first viewpoint. An input unit receives an input indicating a viewpoint different from the first viewpoint. The displayed light field video frame is then displayed with the indicated viewpoint. In one embodiment, two light field video frames of two light field video sequences are displayed respectively in main and side windows on the display device.

Abstract: In one embodiment, it is proposed a method for obtaining at least one sub-aperture image being associated with one view, from raw light field data corresponding to recorded data by an array of pixels sensors positioned behind an array of micro-lenses in a light field camera, each of said pixel sensor recording a linear mixing of up to four different views. The method is remarkable in that it comprises applying a signal separation process on said raw data by using an inverse of a mixing matrix A, said mixing matrix comprising coefficients that convey weighting information of said up to four different views recorded by a pixel sensor.

Abstract: A method for processing data acquired by a sensor pixel array (SPA) of a plenoptic camera is provided. The sensor pixel array (SPA) comprises a plurality of rows and columns of pixels and the plenoptic camera comprises a micro-lens array (MLA) delivering a set of micro-lens images on said sensor pixel array (SPA), each micro-lens image covering at least partially a number of rows and a number of columns of said sensor pixels array. The method for processing data acquired by the sensor pixel array comprises reading-out rows or columns of pixels according to a reading-out order, the reading-out order being defined as a function of said number of rows and/or number of columns and of a number of micro-lens images.

Abstract: Selecting at least one surface in a light field, such as a light field associated with multiple views corresponding to different view points of a same scene, may include displaying one of the multiple views as a reference view, selecting at least one surface in the reference view, identifying a set of pixels belonging to the selected surface, which are occluded in the reference view but visible in at least one of the multiple views, projecting the set of pixels into the reference view on the basis of a value of the pixels of the set in the view or views in which they are visible in order to form an upgraded reference view, displaying the upgraded reference view, and updating the selected surface in the upgraded reference view.

Abstract: The disclosure concerns a user interface for manipulating light-field images. Light-field data provides depth information alongside the images themselves, such that conventional post-processing tools are not adapted to the post-processing of light-field data. Furthermore, the manipulation of light-field images may not be easy and intuitive for non-professional users. The disclosure enables a user to manipulate light-field images in a user-friendly way. Indeed, in this solution, a user only has to select regions of the light-field image to be rendered in-focus, and select a bokeh to be applied to out-of-focus regions of the light-field image as inputs for a post-processing tool. Once the light-field image post-processing tool has processed the light-field image, a final post-processed light-field image is rendered which corresponds to the specifications of the user.

Abstract: The disclosure concerns a method for filtering spurious pixels in a depth-map. It is important to filter a depth-map to remove the spurious pixels. One issue when filtering spurious pixels, is to remove them while preserving the boundaries of the real details of the depth-map. A known approach to filter spurious pixels is to use a bi-lateral filter. However, the bi-lateral filter is not efficient to remove the spurious pixels. The proposed solution enables to remove spurious pixels in a depth-map while preserving the sharp edges of the depth-map and smoothing faint details or noise.

Abstract: A method for obtaining a refocused image from 4D raw light field data for a given focus plane value g is described. The method is executed by an electronic device and is remarkable in that it comprises determining at least one pixel value, for at least one color component, of the refocused image at coordinates (k, l)?N2. The at least one projected pixel value with coordinates comprised in a neighborhood of said coordinates (k, l), for the at least one color component is determined, weighted and updated.

Abstract: The disclosure relates to a method for transferring a style of a reference visual object to an input visual object. According to an embodiment, the method includes finding a correspondence map assigning to a point in the input visual objet a corresponding point in the reference visual object, the finding of a correspondence map comprising spatially adaptive partitioning of the input visual object into a plurality of regions, the partitioning depending on the reference and input visual objects. The disclosure also relates to corresponding electronic device, computer readable program product and computer readable storage medium.

Abstract: A particular implementation determines color palettes of images by extracting and decomposing color palettes based on the image color content. The decomposition can produce a dictionary matrix, an activation matrix, or both. The dictionary matrix can be used in recoloring an image, either directly or after storing. Another implementation selects a color palette to recolor an image by accessing metadata associated with the image and estimating a scene type based on the metadata and/or other information. Color palettes are retrieved from memory corresponding to the scene type of the image and are used for recoloring the image. Instructions for the implementation can be stored on a non-transitory computer readable medium such that the embodiments can be implemented by one or more processors.

Abstract: The invention is related to a method of determining a disparity information associated with at least a block of pixel of a first view of a scene, a matrix of views comprising the first view and a plurality of second views of the scene. The first and second views are obtained by demultiplexing a raw image of the scene acquired with a plenoptic camera but are not demosaiced. The method comprises comparing a first color pattern associated with the first block of the first view with at least one second color pattern associated with at least one second block of at least one of the second views belonging to the row or the column comprising the first view in the matrix; selecting at least one second block if the associated second color pattern corresponds at least partially to the first color pattern; and determining the disparity information associated with the first block by using the selected at least one second block and the first block.

Abstract: Method and device adapted for the processing of lightfield data representative of a scene, said lightfield data comprising a plurality of elements, 4-dimensional coordinates being associated with each element. Following operations are performed: associating a ray with each element, the ray being obtained from the 4-dimensional coordinates associated with each element; determining a depth information for each element; determining an origin of each ray in the scene according to the depth information; grouping rays having a same origin in the scene to form a plurality of groups; processing the lightfield data according to the plurality of groups.

Abstract: An image sensor unit (3) includes a microlens array (31) and a sensor (32). The sensor includes a plurality of sensor regions (323) that respectively include pixels (322) having different sensitivities arranged in a matrix arrangement. The pixels (322) at corresponding positions of the plurality of sensor regions (323) have identical sensitivities. Each of the microlenses (311) of the microlens array (31) is arranged to direct the light to a corresponding one of the plurality of sensor regions (323) of the sensor (32).

Abstract: An apparatus to process a lightfield image of a scene acquired with a lightfield acquisition device comprises means for obtaining a first focal stack and a second focal stack, each comprising images representative of the scene and obtained from a different part of the pixels of the lightfield image. A method of processing the lightfield content is also described.

Abstract: The present invention generally relates to COLOR transfer between two images. COLOR transfer is a known technic consisting in modifying the COLORs of a source image by applying the COLOR palette of an example image without changing the source image structure. A lot of COLOR transfer method are known which consist in transferring COLORs between two images, however, those methods do not preserve the quality of the bokeh in areas of an images that are not in focus at a given depth. This results in a navigation in the depth dimension that is not smooth. It is proposed to modify the COLORs of a focal stack of a scene according to a COLOR palette by propagating the COLORs of the pixels in focus in different layers of the reCOLORed focal stack to the layers of the reCOLORed focal stack located behind the layer wherein a considered pixel is in focus.

Abstract: A method of providing metadata for captured light field data, the method comprising providing a data format aggregating metadata describing characteristics of at least one of: a light field camera used to capture the light field data, a matrix of views derived from the light field data, and a focal stack derived from the light field data.

Abstract: One general aspect for motion-based video tonal stabilization uses a keyframe and motion estimation techniques to determine the level of spatial correspondence between input images and the keyframe. When the level of spatial correspondence is high, tonal stabilization is performed through regression and power law tonal transformation to minimize the color differences between images caused by automatic camera parameters without a priori knowledge of the camera model. Tonal error accumulation is reduced by using long-term tonal propagation.

Abstract: An image sensor unit (3) includes a microlens array (31) and a sensor (32). The sensor includes a plurality of sensor regions (323) that respectively include pixels (322) having different sensitivities arranged in a matrix arrangement. The pixels (322) at corresponding positions of the plurality of sensor regions (323) have identical sensitivities. Each of the microlenses (311) of the microlens array (31) is arranged to direct the light to a corresponding one of the plurality of sensor regions (323) of the sensor (32).

Abstract: Methods and apparatus for estimating a depth of unfocused plenoptic data are suggested. The method includes: determining a level of homogeneity of micro-lens images of unfocused plenoptic data; determining pixels of the micro-lens images of the unfocused plenoptic unfocused plenoptic data which either have disparities equal to zero or belong to homogeneous areas as a function of the calculated level of homogeneity of the micro-lens images of the unfocused plenoptic data; and estimating the depth of the unfocused plenoptic data by a disparity estimation without considering the determined pixels. With the disclosure, by pre-processing the raw data, it can prevent any disparity estimation method to spend time on estimating disparities for: (i) pixels that are in focus, (ii) pixels that belong to homogenous areas of the scene.