Abstract: Methods, systems, and computer readable media for minimal-latency tracking and display for matching real and virtual worlds in head-worn displays are disclosed. According to one aspect, a method for minimal-latency tracking and display for matching real and virtual worlds in head-worn displays includes calculating a desired image, calculating an error image as the difference between the desired image and an image currently being perceived by a user, identifying as an error portion a portion of the error image having the largest error, updating a portion of a projected image that corresponds to the error portion, and recalculating the image currently being perceived by a user based on the updated projected image.

Abstract: Methods, systems, and computer readable media for low latency stabilization for head-worn displays are disclosed. According to one aspect, the subject matter described herein includes a system for low latency stabilization of a head-worn display. The system includes a low latency pose tracker having one or more rolling-shutter cameras that capture a 2D image by exposing each row of a frame at a later point in time than the previous row and that output image data row by row, and a tracking module for receiving image data row by row and using that data to generate a local appearance manifold. The generated manifold is used to track camera movements, which are used to produce a pose estimate.

Abstract: Methods, systems, and computer readable media for minimal-latency tracking and display for matching real and virtual worlds in head-worn displays are disclosed. According to one aspect, a method for minimal-latency tracking and display for matching real and virtual worlds in head-worn displays includes calculating a desired image, calculating an error image as the difference between the desired image and an image currently being perceived by a user, identifying as an error portion a portion of the error image having the largest error, updating a portion of a projected image that corresponds to the error portion, and recalculating the image currently being perceived by a user based on the updated projected image.

Abstract: Methods, systems, and computer readable media for low latency stabilization for head-worn displays are disclosed. According to one aspect, the subject matter described herein includes a system for low latency stabilization of a head-worn display. The system includes a low latency pose tracker having one or more rolling-shutter cameras that capture a 2D image by exposing each row of a frame at a later point in time than the previous row and that output image data row by row, and a tracking module for receiving image data row by row and using that data to generate a local appearance manifold. The generated manifold is used to track camera movements, which are used to produce a pose estimate.

Abstract: A pixel compositor device for routing an incoming stream of pixel data having been rendered elsewhere and bound for being projected. The device includes a plurality of digital signal inputs each adapted for receiving a plurality of pixel information from the incoming stream of pixel data. The digital signal inputs are in communication with at least one buffer for the pixel information once received by the device. A processing unit is included for image warping the pixel information by performing, on each of a respective of the pixel information: (i) a mapping relating to location of the respective pixel information, and (ii) a scaling function. The geometric mapping can be performed by applying an interpolation technique; and the scaling function can be any of a number of photometric correction functions (alpha-blending, color uniformity correction, image brightness or contrast adjustment, etc.).

Abstract: Methods and apparatus for rendering images are presented. The method includes the step of segmenting at least one reference image in a reference image space into a plurality of tiles, each tile defined by a corresponding set of image samples. The connectivity of each of the samples is determined based on the relative curvature of a surface of the corresponding tile at the sample coordinates. Color and depth information between adjacent, connected samples is bi-linearly interpolated to form a corresponding set of sub-samples. The set of sub-samples are warped from the reference image space to a destination image space. A final pixel color for each of a plurality of groups of sub-samples in the destination image space is computed as a weighted average of the color information of the sub-samples for each respective group. The final pixel colors are combined to render a final image in the destination image space from the at least one reference image.

Abstract: Methods and apparatus for rendering images are presented. The method includes the step of segmenting at least one reference image in a reference image space into a plurality of tiles, each tile defined by a corresponding set of image samples. The connectivity of each of the samples is determined based on the relative curvature of a surface of the corresponding tile at the sample coordinates. Color and depth information between adjacent, connected samples is bi-linearly interpolated to form a corresponding set of sub-samples. The set of sub-samples are warped from the reference image space to a destination image space. A final pixel color for each of a plurality of groups of sub-samples in the destination image space is computed as a weighted average of the color information of the sub-samples for each respective group. The final pixel colors are combined to render a final image in the destination image space from the at least one reference image.