Abstract: A mechanism is described for facilitating cinematic space-time view synthesis in computing environments according to one embodiment. A method of embodiments, as described herein, includes capturing, by one or more cameras, multiple images at multiple positions or multiple points in times, where the multiple images represent multiple views of an object or a scene, where the one or more cameras are coupled to one or more processors of a computing device. The method further includes synthesizing, by a neural network, the multiple images into a single image including a middle image of the multiple images and representing an intermediary view of the multiple views.

Abstract: Techniques related to optical flow estimation for equirectangular images are discussed. Such techniques include combining an optical flow map generated using an input pair of equirectangular images and an optical flow map generated using a transformed pair of equirectangular images rotated with respect to the input pair to move polar regions in the input pair to central regions in the transformed pair.

Abstract: A mechanism is described for facilitating cinematic space-time view synthesis in computing environments according to one embodiment. A method of embodiments, as described herein, includes capturing, by one or more cameras, multiple images at multiple positions or multiple points in times, where the multiple images represent multiple views of an object or a scene, where the one or more cameras are coupled to one or more processors of a computing device. The method further includes synthesizing, by a neural network, the multiple images into a single image including a middle image of the multiple images and representing an intermediary view of the multiple views.

Abstract: A mechanism is described for facilitating cinematic space-time view synthesis in computing environments according to one embodiment. A method of embodiments, as described herein, includes capturing, by one or more cameras, multiple images at multiple positions or multiple points in times, where the multiple images represent multiple views of an object or a scene, where the one or more cameras are coupled to one or more processors of a computing device. The method further includes synthesizing, by a neural network, the multiple images into a single image including a middle image of the multiple images and representing an intermediary view of the multiple views.

Abstract: Methods, apparatus, systems, and articles of manufacture to process high-speed video are disclosed. An example apparatus comprises at least one memory; instructions in the apparatus; and processor circuitry to execute the instructions to: interleave a plurality of images from a first camera and a second camera in chronological order, the first camera to capture first images of the plurality of images, the second camera to capture second images of the plurality of images at a different time offset than the first camera; and generate video with an adaptive frame rate from the plurality of images by applying a mask to the plurality of images.

Abstract: An example system for generating light field content is described herein. The system includes a receiver to receive a plurality of images and a calibrator to intrinsically calibrate a camera. The system also includes a corrector and projector undistort the images and project the undistorted images to generate undistorted rectilinear images. An extrinsic calibrator may rectify and align the undistorted rectilinear images. Finally, the system includes a view interpolator to perform intermediate view interpolation on the rectified and aligned undistorted rectilinear images.

Abstract: An example system for generating stereoscopic light field panoramas includes at least one memory; and at least one processor to execute instructions to: access images of a scene captured by a plurality of cameras, the images including light field information associated with the scene; generate, based on first portions of the images, a first stereoscopic light field panorama for a first perspective associated with a left eye viewpoint of the scene, the left eye viewpoint associated with a left eye position on a first circle; and generate, based on second portions of the images, a second stereoscopic light field panorama for a second perspective associated with a right eye viewpoint of the scene, the right eye viewpoint associated with a right eye position on a second circle, the first circle being different than and concentric to the second circle.

Abstract: An example method is described herein. The method includes executing dense feature matching on an image pair that is down sampled to obtain a first set of feature correspondences for each pixel of the down sampled image pair. The method also includes calculating a neighborhood correspondence based on the first set of feature correspondences for each pixel in a first image of the image pair. Further, the method includes executing sparse feature matching on stereoscopic patch pairs from the image pair based on the neighborhood correspondence for each pixel to obtain correspondence estimates for each stereoscopic patch pair. Finally, the method includes refining the correspondence estimates for each stereoscopic patch pair to obtain a semi-dense set of feature correspondences by applying a geometric constraint to the correspondence estimates and retaining correspondences that satisfy the geometric constraint.

Abstract: Methods, apparatus, systems, and articles of manufacture to process high-speed video are disclosed. An example apparatus comprises at least one memory; instructions in the apparatus; and processor circuitry to execute the instructions to: interleave a plurality of images from a first camera and a second camera in chronological order, the first camera to capture first images of the plurality of images, the second camera to capture second images of the plurality of images at a different time offset than the first camera; and generate video with an adaptive frame rate from the plurality of images by applying a mask to the plurality of images.

Abstract: Methods and apparatus are disclosed herein to synthesize six degree-of-freedom views from sparce RGB-depth inputs. An example apparatus includes at least one memory, instructions in the apparatus, and processor circuitry to execute the instructions to reproject a first red-green-blue (RGB) depth view and a second RGB depth view to a target camera position to obtain a first reprojected view and a second reprojected view, combine the first reprojected view and the second reprojected view into a blended view data based on a first weight map and a second weight map, the blended view including missing RGB depth information due to at least one of an occlusion or a disocclusion, and generate a six degree-of-freedom synthesized view of the blended view data, the synthesized view including the missing RGB depth information.

Abstract: A mechanism is described for facilitating cinematic space-time view synthesis in computing environments according to one embodiment. A method of embodiments, as described herein, includes capturing, by one or more cameras, multiple images at multiple positions or multiple points in times, where the multiple images represent multiple views of an object or a scene, where the one or more cameras are coupled to one or more processors of a computing device. The method further includes synthesizing, by a neural network, the multiple images into a single image including a middle image of the multiple images and representing an intermediary view of the multiple views.

Abstract: An apparatus for high-speed video is described herein. The apparatus includes a camera array, wherein each camera of the camera array is to capture an image at a different time offset resulting in a plurality of images. The apparatus also includes a controller to interleave the plurality of images in chronological order and a view synthesis unit to synthesize a camera view from a virtual camera for each image of the plurality of images. Additionally, the apparatus includes a post-processing unit to remove any remaining artifacts from the plurality of images.

Abstract: A mechanism is described for facilitating cinematic space-time view synthesis in computing environments according to one embodiment. A method of embodiments, as described herein, includes capturing, by one or more cameras, multiple images at multiple positions or multiple points in times, where the multiple images represent multiple views of an object or a scene, where the one or more cameras are coupled to one or more processors of a computing device. The method further includes synthesizing, by a neural network, the multiple images into a single image including a middle image of the multiple images and representing an intermediary view of the multiple views.

Abstract: Disclosed herein is display stacks for virtual reality (VR) displays arranged to present an image where a focal point of the image is presented in higher resolution than a periphery around the focal point. The disclosure provides systems and methods for presenting an image comprising a high resolution having a smaller field of view than that with which a lower resolution image is presented around a periphery of the high resolution image.

Abstract: Technology for improving performance of a personal display device by variably controlling the emission divergence and/or the emission direction of light from the pixels of the display as a function of the location of the pixel within a display.

Abstract: An example system for generating stereoscopic light field panoramas includes at least one memory; and at least one processor to execute instructions to: access images of a scene captured by a plurality of cameras, the images including light field information associated with the scene; generate, based on first portions of the images, a first stereoscopic light field panorama for a first perspective associated with a left eye viewpoint of the scene, the left eye viewpoint associated with a left eye position on a first circle; and generate, based on second portions of the images, a second stereoscopic light field panorama for a second perspective associated with a right eye viewpoint of the scene, the right eye viewpoint associated with a right eye position on a second circle, the first circle being different than and concentric to the second circle.

Abstract: Techniques related to optical flow estimation for equirectangular images are discussed. Such techniques include combining an optical flow map generated using an input pair of equirectangular images and an optical flow map generated using a transformed pair of equirectangular images rotated with respect to the input pair to move polar regions in the input pair to central regions in the transformed pair.

Abstract: Techniques related to generating a virtual view of a scene from a position between positions of known input images for presentation to a viewer are discussed. Such techniques include applying a convolution mask that approximates an inverse of a linear combination of at least the horizontal and vertical convolution matrices representative of gradient detection in the input images to a virtual intermediate gradient image that is a combination of at least an interpolated virtual image at the position, an interpolated horizontal gradient map at the position, and an interpolated vertical gradient map at the position to generate a final virtual image for the position.

Abstract: A mechanism is described for facilitating cinematic space-time view synthesis in computing environments according to one embodiment. A method of embodiments, as described herein, includes capturing, by one or more cameras, multiple images at multiple positions or multiple points in times, where the multiple images represent multiple views of an object or a scene, where the one or more cameras are coupled to one or more processors of a computing device. The method further includes synthesizing, by a neural network, the multiple images into a single image including a middle image of the multiple images and representing an intermediary view of the multiple views.

Abstract: An example system for generating stereoscopic light field panoramas includes a receiver to receive a plurality of synchronized images. The system also includes a calibrator and projector to calibrate the synchronized images, undistort the synchronized images, and project the undistorted images to a sphere to generate undistorted rectilinear images. The system further includes a disparity estimator to estimate a disparity between neighboring views of the undistorted rectilinear images to determine an optical flow between the undistorted rectilinear images. The system includes a view interpolator to perform in-between view interpolation on the undistorted rectilinear images based on the optical flow. The system also further includes a light field panorama generator to generate a stereoscopic light field panorama for a plurality of perspectives using concentric viewing circles.