Abstract: High speed video capture and depth estimation using array cameras is disclosed. Real world scenes typically include objects located at different distances from a camera. Therefore, estimating depth during video capture by an array camera can result in smoother rendering of video from image data captured of real world scenes. One embodiment of the invention includes cameras that capture images from different viewpoints, and an image processing pipeline application that obtains images from groups of cameras, where each group of cameras starts capturing image data at a staggered start time relative to the other groups of cameras. The application then selects a reference viewpoint and determines scene-dependent geometric corrections that shift pixels captured from an alternate viewpoint to the reference viewpoint by performing disparity searches to identify the disparity at which pixels from the different viewpoints are most similar. The corrections can then be used to render frames of video.

Abstract: High speed video capture and depth estimation using array cameras is disclosed. Real world scenes typically include objects located at different distances from a camera. Therefore, estimating depth during video capture by an array camera can result in smoother rendering of video from image data captured of real world scenes. One embodiment of the invention includes cameras that capture images from different viewpoints, and an image processing pipeline application that obtains images from groups of cameras, where each group of cameras starts capturing image data at a staggered start time relative to the other groups of cameras. The application then selects a reference viewpoint and determines scene-dependent geometric corrections that shift pixels captured from an alternate viewpoint to the reference viewpoint by performing disparity searches to identify the disparity at which pixels from the different viewpoints are most similar. The corrections can then be used to render frames of video.

Abstract: A system to process a signal sequence is described. A hybrid block matching and transform based N-Dimensional signal sequence encoder and decoder is disclosed. The encoder includes encoder side block matching predictor, which includes entropy based cost function which can be estimated from certain energy measure of the block matching difference; a fast block matching search method to learn the results from neighboring blocks and to perform large range search with only a small number of points to visit.

Abstract: A system and method to process a signal sequence is described. A hybrid block matching and transform based N-Dimensional signal sequence encoder and decoder is disclosed. The encoder includes encoder side block matching predictor, which includes entropy based cost function which can be estimated from certain energy measure of the block matching difference; a fast block matching search method to learn the results from neighboring blocks and to perform large range search with only a small number of points to visit. A method is disclosed to dynamically adjust the cost function parameters and other coding control parameters based on encoder outputs, and to optimize the quality and performance of the encoder. A method is disclosed to enable exploring and rapid processing of fractional grid points for n-dimensional block matching. A hybrid block matching and transform based n-dimensional signal sequence decoder is disclosed.