Abstract: Methods and systems for light field image encoding and decoding are disclosed. According to some embodiments, scene metadata and input light field images associated with a scene are received. A first encoding operation is performed on the scene metadata and input light field images to generate reference images, reference disparity information, and an order of reference views. A second encoding operation is performed based on the reference images and reference disparity information to output light field encoded data. The light field encoded data includes the encoded reference images, the encoded reference disparity information, and the order of reference views. The light field encoded data is transmitted.

Abstract: Methods and systems for light field image encoding and decoding are disclosed. According to some embodiments, the method receives scene metadata and input light field images associated with a scene. The method further performs a first encoding operation on the scene metadata and the input light field images to generate reference views and reference disparity information. The method further performs a second encoding operation based on the reference views, the reference disparity information, and synthesized residuals to output encoded light field data, where the encoded light field data comprises encoded reference views, encoded reference disparity information, and encoded synthesized residuals. The method further randomly accesses and selects a group of reference views and corresponding disparity information from the encoded light field data based on one or more selected regions of interest.

Abstract: Methods and systems for image encoding and decoding are disclosed. According to some embodiments, scene metadata and input images associated with a scene are received. A first encoding operation is performed on the scene metadata and input images to generate reference images and reference disparity information. A second encoding operation is performed on the reference images and reference disparity information to output encoded data. The encoded data includes encoded reference images and encoded reference disparity information. The encoded data is transmitted.

Abstract: Methods and systems for image encoding and decoding are disclosed. According to some embodiments, scene metadata and input images associated with a scene are received. A first encoding operation is performed on the scene metadata and input images to generate reference images and reference disparity information. A second encoding operation is performed on the reference images and reference disparity information to output encoded data. The encoded data includes encoded reference images and encoded reference disparity information. The encoded data is transmitted.

Abstract: Methods and systems for image encoding and decoding are disclosed. According to some embodiments, scene metadata and input images associated with a scene are received. A first encoding operation is performed on the scene metadata and input images to generate reference images and reference disparity information. A second encoding operation is performed on the reference images and reference disparity information to output encoded data. The encoded data includes encoded reference images and encoded reference disparity information. The encoded data is transmitted.

Abstract: Methods and systems for light field image encoding and decoding are disclosed. According to some embodiments, scene metadata and input light field images associated with a scene are received. A first encoding operation is performed on the scene metadata and input light field images to generate reference images, reference disparity information, and an order of reference views. A second encoding operation is performed based on the reference images and reference disparity information to output light field encoded data. The light field encoded data includes the encoded reference images, the encoded reference disparity information, and the order of reference views. The light field encoded data is transmitted.

Abstract: A compression method for high-resolution light field display is disclosed for applications in which computer memory constraints and latency are critical. The disclosed compression algorithm takes advantage of the 3D structure of a light field to compress the raw light field information with a fixed compression ratio and simple decoding instructions. The compressed high-resolution light field achieves a reduced bandwidth with acceptable quality, and is packed in a way that can be transmitted using common interfaces. In a preferred embodiment, the compression algorithm is used as a post-processing stage after light field information acquisition or after rendering. In a further preferred embodiment, the compression algorithm is incorporated into the acquisition or rendering procedure to reduce memory and rendering processing. These and further embodiments generate a compressed light field with all information required for direct display.

Abstract: Methods and systems for light field image encoding and decoding are disclosed. According to some embodiments, scene metadata and input light field images associated with a scene are received. A first encoding operation is performed on the scene metadata and input light field images to generate reference images, reference disparity information, and an order of reference views. A second encoding operation is performed based on the reference images and reference disparity information to output light field encoded data. The light field encoded data includes the encoded reference images, the encoded reference disparity information, and the order of reference views. The light field encoded data is transmitted.

Abstract: Emissive micro-pixel spatial light modulators with non-telecentric emission are introduced. The individual light emission from each multi-color micro-scale emissive pixel is directionally modulated in a unique direction to enable application-specific non-telecentric emission pattern from the micro-pixel array of the emissive spatial light modulator. Design methods for directionally modulating the light emission of the individual micro-pixels using micro-pixel level optics are described. Monolithic wafer level optics methods for fabricating the micro-pixel level optics are also described. An emissive multi-color micro-pixel spatial light modulator with non-telecentric emission is used to exemplify the methods and possible applications of the present invention: ultra-compact image projector, minimal cross-talk 3D light field display, multi-view 2D display, and directionally modulated waveguide optics for see-through near-eye displays.

Abstract: A compression method for high-resolution light field display is disclosed for applications in which computer memory constraints and latency are critical. The disclosed compression algorithm takes advantage of the 3D structure of a light field to compress the raw light field information with a fixed compression ratio and simple decoding instructions. The compressed high-resolution light field achieves a reduced bandwidth with acceptable quality, and is packed in a way that can be transmitted using common interfaces. In a preferred embodiment, the compression algorithm is used as a post-processing stage after light field information acquisition or after rendering. In a further preferred embodiment, the compression algorithm is incorporated into the acquisition or rendering procedure to reduce memory and rendering processing. These and further embodiments generate a compressed light field with all information required for direct display.

Abstract: Methods and systems for light field image encoding and decoding are disclosed. According to some embodiments, the method receives scene metadata and input light field images associated with a scene. The method further performs a first encoding operation on the scene metadata and the input light field images to generate reference views and reference disparity information. The method further performs a second encoding operation based on the reference views, the reference disparity information, and synthesized residuals to output encoded light field data, where the encoded light field data comprises encoded reference views, encoded reference disparity information, and encoded synthesized residuals. The method further randomly accesses and selects a group of reference views and corresponding disparity information from the encoded light field data based on one or more selected regions of interest.

Abstract: Methods and systems for light field image encoding and decoding are disclosed. According to some embodiments, scene metadata and input light field images associated with a scene are received. A first encoding operation is performed on the scene metadata and input light field images to generate reference images, reference disparity information, and an order of reference views. A second encoding operation is performed based on the reference images and reference disparity information to output light field encoded data. The light field encoded data includes the encoded reference images, the encoded reference disparity information, and the order of reference views. The light field encoded data is transmitted.

Abstract: A compression method for high-resolution light field display is disclosed for applications in which computer memory constraints and latency are critical. The disclosed compression algorithm takes advantage of the 3D structure of a light field to compress the raw light field information with a fixed compression ratio and simple decoding instructions. The compressed high-resolution light field achieves a reduced bandwidth with acceptable quality, and is packed in a way that can be transmitted using common interfaces. In a preferred embodiment, the compression algorithm is used as a post-processing stage after light field information acquisition or after rendering. In a further preferred embodiment, the compression algorithm is incorporated into the acquisition or rendering procedure to reduce memory and rendering processing. These and further embodiments generate a compressed light field with all information required for direct display.

Abstract: A compressed light field imaging system is described. The light field 3D data is analyzed to determine optimal subset of light field samples to be (acquired) rendered, while the remaining samples are generated using multi-reference depth-image based rendering. The light field is encoded and transmitted to the display. The 3D display directly reconstructs the light field and avoids data expansion that usually occurs in conventional imaging systems. The present invention enables the realization of full parallax 3D compressed imaging system that achieves high compression performance while minimizing memory and computational requirements.

Abstract: 3D light field display methods and apparatus with improved viewing angle, depth and resolution are introduced. The methods can be used to create a high quality 3D light field display of any size from smaller than a postage stamp to larger than a three story building.

Abstract: A compressed light field imaging system is described. The light field 3D data is analyzed to determine optimal subset of light field samples to be (acquired) rendered, while the remaining samples are generated using multi-reference depth-image based rendering. The light field is encoded and transmitted to the display. The 3D display directly reconstructs the light field and avoids data expansion that usually occurs in conventional imaging systems. The present invention enables the realization of full parallax 3D compressed imaging system that achieves high compression performance while minimizing memory and computational requirements.

Abstract: Methods and systems for light field compression are disclosed. According to some embodiments, the method receives pre-processing information that includes subimages associated with a scene. The method performs a first compression operation on the pre-processing information to generate reference information. The method further performs a second compression operation on the reference information and residual information to output compressed information. The compressed information includes compressed reference information and compressed residual information.

Abstract: Methods and systems for image encoding and decoding are disclosed. According to some embodiments, scene metadata and input images associated with a scene are received. A first encoding operation is performed on the scene metadata and input images to generate reference images and reference disparity information. A second encoding operation is performed on the reference images and reference disparity information to output encoded data. The encoded data includes encoded reference images and encoded reference disparity information. The encoded data is transmitted.

Abstract: Methods and systems for compression of light field images using Multiple Reference Depth Image-Based Rendering techniques (MR-DIBR) are disclosed. The methods and systems enhance light field image quality of compressed light field images using reference depth (or disparity) and color maps to enable hole filling and crack filling in compressed light field image data sets.

Abstract: Image compression methods for near-eye display systems that reduce the input bandwidth and the system processing resource are disclosed. High order basis modulation, dynamic gamut, light field depth sampling and image data word-length truncation and quantization aiming at matching the human visual system angular, color and depth acuity coupled with use of compressed input display enable a high fidelity visual experience in near-eye display systems suited for mobile applications at a substantially reduced input interface bandwidths and processing resources.