Abstract: The present disclosure relates to omnipolar imaging for generating a substantially 360 degree by 180 degree stereo spherical view. The omnipolar imaging device comprises at least three wide angle lenses facing in a first direction and at least three wide angle lenses facing in a second direction opposite to the first direction, each lens connected to an image sensor. The lens are positioned so as to capture the substantially 360 degree by 180 degree view. The method of rendering the view comprises, for each pixel in an output image, selecting one set of lenses, i.e. the first set of lenses or the second set of lenses, selecting one lens from the selected set of lenses, and rendering the pixel in an output image from a corresponding point in an input image of the selected lens.

Abstract: A Head-Mounted Display with camera sensors to perform chroma keying in a mixed reality context is presented. Low latency is achieved by embedding the processing in the HMD itself, specifically, format camera images, detect the selected color range and make a composite with the virtual content.

Abstract: One exemplary implementation facilitates object detection using multiple scans of an object in different conditions. For example, a first scan of the object can be created by capturing images of the object by moving an image sensor on a first path in a first condition, e.g., bright lighting. A second scan of the object can then be created by capturing additional images of the object by moving the image sensor on a second path in a second condition, e.g., dim lighting. Implementations determine a transform that associates the scan data from these multiple scans to one another and use the transforms to generate a 3D model of the object in a single coordinate system. Augmented content can be positioned relative to that object in the single coordinate system and thus will be displayed in the appropriate location regardless of the condition in which the physical object is later detected.

Abstract: A Head-Mounted Display system together with associated techniques for performing accurate and automatic inside-out positional, user body and environment tracking for virtual or mixed reality are disclosed. The system uses computer vision methods and data fusion from multiple sensors to achieve real-time tracking. High frame rate and low latency is achieved by performing part of the processing on the HMD itself.

Abstract: The present disclosure relates to omnipolar imaging for generating a substantially 360 degree by 180 degree stereo spherical view. The omnipolar imaging device comprises at least three wide angle lenses facing in a first direction and at least three wide angle lenses facing in a second direction opposite to the first direction, each lens connected to an image sensor. The lens are positioned so as to capture the substantially 360 degree by 180 degree view. The method of rendering the view comprises, for each pixel in an output image, selecting one set of lenses, i.e. the first set of lenses or the second set of lenses, selecting one lens from the selected set of lenses, and rendering the pixel in an output image from a corresponding point in an input image of the selected lens.

Abstract: A method for generating a 360 degree view. N input images are captured from N cameras fixed at a baseline height equidistantly about a circle in an omnipolar camera setup where N?3. Two epipolar lines are defined per field of view from the cameras to divide the field of view of each one of the cameras into four parts. Image portions from each one of the cameras are stitched together along vertical stitching planes passing through the epipolar lines. Regions corresponding to a visible camera are removed from the image portions using deviations performed along the epipolar lines. Output images are formed for left and right eye omnistereo views by stitching together the first one of the four parts from each one of the fields of view and the second one of the four parts from each one of the fields of view, respectively.

Abstract: A method for generating a 360 degree view. N input images are captured from N cameras fixed at a baseline height equidistantly about a circle in an omnipolar camera setup where N?3. Two epipolar lines are defined per field of view from the cameras to divide the field of view of each one of the cameras into four parts. Image portions from each one of the cameras are stitched together along vertical stitching planes passing through the epipolar lines. Regions corresponding to a visible camera are removed from the image portions using deviations performed along the epipolar lines. Output images are formed for left and right eye omnistereo views by stitching together the first one of the four parts from each one of the fields of view and the second one of the four parts from each one of the fields of view, respectively.

Abstract: There is described a camera setup for capturing omnistereo images using a minimum of three cameras with ultra wide angle lenses and a method for generating a substantially 360 degree view from images taken from the cameras. The field of view covered in stereo may be a dome. The baseline between pairs of cameras defines epipoles which can be used for stitching without any horizontal misalignments due to parallax. The method comprises capturing the images from a plurality of cameras fixed at a baseline height substantially equidistantly about a circle; and stitching together portions of the images from each one of the plurality of cameras along first and second borders corresponding at least in part to lines joining center points of neighboring ones of the plurality of cameras.

Abstract: There is described a camera setup for capturing omnistereo images using a minimum of three cameras with ultra wide angle lenses and a method for generating a substantially 360 degree view from images taken from the cameras. The field of view covered in stereo may be a dome. The baseline between pairs of cameras defines epipoles which can be used for stitching without any horizontal misalignments due to parallax. The method comprises capturing the images from a plurality of cameras fixed at a baseline height substantially equidistantly about a circle; and stitching together portions of the images from each one of the plurality of cameras along first and second borders corresponding at least in part to lines joining center points of neighboring ones of the plurality of cameras.