Abstract: In an exemplary process for determining a position of an object in a computer-generated reality environment using an eye gaze, a user uses their eyes to interact with user interface objects displayed on an electronic device. A first direction of gaze is determined for a first eye of a user detected via the one or more cameras, and a second direction of gaze is determined for a second eye of the user detected via the one or more cameras. A convergence point of the first and second directions of gaze is determined, and a distance between a position of the user and a position of an object in the computer-generated reality environment is determined based on the convergence point. A task is performed based on the determined distance between the position of the user and the position of the object in the computer-generated reality environment.

Abstract: The present disclosure relates to a method for calibrating a projector. The method includes projecting a test pattern onto a scene or an object within the scene and capturing the test pattern using a camera. Once the test pattern image has been captured by the camera, the method further includes estimating by a processing element a perspective projection matrix, warping the estimated projection matrix based on a non-linear distortion function, and modifying the projector to project light based on the distortion function. The present disclosure also relates to a presentation or projection system including two types of projectors for projecting an output presentation having a second image overlaid on a first image.

Abstract: A method includes obtaining rendered image data that includes a representation of an object for display using a see-through display. The see-through display permits ambient light from a physical environment through the see-through display. The method includes sensing a plurality of light superposition characteristic values associated with the ambient light that quantifies the ambient light. The method includes determining a plurality of display correction values associated with the electronic device based on the plurality of light superposition characteristic values and predetermined display characteristics of the representation of the object. The method includes generating, from the rendered image data, display data for the see-through display in accordance with the plurality of display correction values in order to satisfy the predetermined display characteristics of the representation of the object within a performance threshold.

Abstract: A method includes sensing a plurality of light superposition characteristic values associated with ambient light from a physical environment. The ambient light emanates from the physical environment towards one side of a translucent display. The plurality of light superposition characteristic values quantifies interactions with the ambient light. The method includes determining a plurality of display correction values associated with the electronic device based on a function of the plurality of light superposition characteristic values and predetermined display characteristics of a computer-generated reality (CGR) object. The method includes changing one or more display operating parameters associated with the electronic device in accordance with the plurality of display correction values in order to satisfy the predetermined display characteristics of the CGR object within a performance threshold.

Abstract: Various implementations disclosed herein include devices, systems, and methods that select colors for visual markers that include colored markings encoding data. In some implementations, the colors are automatically or semi-automatically selected. In some implementations, the colors are selected to remain sufficiently detectable despite changes in lighting conditions or printing/display conditions. In some implementations, a set of colors selectable for use in a visual marker is obtained. Then, measures of distance between a plurality of colors of the set of colors is determined, and a subset of the set of colors for the visual marker is selected based on the measure of distance between colors of the subset of colors. In some implementations, the visual marker appearance includes graphical elements encoding data using the subset of colors. In some implementations, input is received using a GUI on a display to determine multiple colors based on a source image.

Abstract: Various implementations disclosed herein include devices, systems, and methods that determine the relative positioning (e.g., offset) between a mobile electronic device and a visual marker. In some implementations, the determined relative positioning and a known position of the visual marker are used to determine a position (e.g., geo coordinates) of the mobile electronic device that is more accurate than existing techniques. In some implementations, the determined relative positioning is used with a position of the mobile electronic device to crowd source the stored position of the visual marker. In some implementations, the determined relative positioning and a position of the visual marker are used to determine a position of an object detected in an image by the mobile electronic device. In some implementations at an electronic device having a processor, locally-determined locations of a visual marker are received from mobile electronic devices that scan a visual marker.

Abstract: Various implementations disclosed herein adjust the luminance values of an image to improve the appearance of the image on an augmented reality device. In some implementations, the luminance values of an image are adjusted so that the image can be displayed on an augmented reality device (e.g., with background luminance) such that the image will be perceived more similarly to how the image would be perceived otherwise (e.g., on a device without background luminance). In some implementations, an image is adjusted based on an estimate of human perception of luminance that is not linear.

Abstract: Various implementations disclosed herein include devices, systems, and methods that use an object as a background for virtual content. Some implementations involve obtaining an image of a physical environment. A location of a surface of an object is detected based on the image. A virtual content location to display virtual content is determined, where the virtual content location corresponds to the location of the surface of the object. Then, a view of the physical environment and virtual content displayed at the virtual content location is provided.

Abstract: In one implementation, a method of directing a user's attention is performed by a device including one or more processors, non-transitory memory, a scene camera and an optical passthrough display. The method includes capturing, using the scene camera, an image of a scene. The method includes determining, using the one or more processors, one or more attention-indirection regions based on the image of the scene. The method includes displaying, on the optical see-through display, a masking image including a masking pattern in the one or more attention-indirection regions.

Abstract: The present disclosure relates to a system and method for calibrating an optical device, such as a camera. In one example, the system includes a light-emitting device that generates light patterns and an ray generator that is positioned between the light-emitting device and the optical device. The ray generator separates the light emitted as part of the light patterns into a plurality of directional rays. The optical device then captures the directional rays and the captured data, along with data corresponding to the light pattern and the ray generator, are used to calibrate the optical device.

Abstract: A method and system for optimizing projection surfaces for generating visible images. The projection system may include a projector that emits light in the ultraviolet range and a screen in optical communication with the projector. The screen includes a visible light absorbing layer, a transparent layer positioned over the visible light absorbing layer, and a plurality of fluorescent colorants printed on the transparent layer in a predetermined pattern, where the light emitted by the projector excites the fluorescent colorants to emit visible light forming the visible images. The predetermined pattern can be optimized to increase a color gamut of the formed images by varying surface coverage ratios of the fluorescent colorants.

Abstract: The present disclosure generally relates to printed structures and methods for generating the same. The printed structure includes a first surface including a first ink type arranged in a first image and a second surface at least partially aligned with at least a portion of the first surface, the second surface including a second type of ink arranged in a second image. The first and second surfaces are physically separated from one another, the first image is visible under a first set of light wavelengths and the second image is visible under a second set of light wavelengths.

Abstract: A method of augmenting a human face with projected light is disclosed. The method includes determining a blend of component attributes to define visual characteristics of the human face, modifying an input image based, at least in part, on an image of the human face, wherein the modified input image defines an augmented visual characteristic of the human face, determining a present location of one or more landmarks on the human face based, at least in part, on the image of the human face, predicting a future location of the one or more landmarks, deforming a model of the human face based on the future location of the one or more landmarks, generating an augmentation image based on the deformed model and the modified input image, and transmitting for projection the augmentation image.

Abstract: The present disclosure generally relates to printed structures and methods for generating the same. The printed structure includes a first surface including a first ink type arranged in a first image and a second surface at least partially aligned with at least a portion of the first surface, the second surface including a second type of ink arranged in a second image. The first and second surfaces are physically separated from one another, the first image is visible under a first set of light wavelengths and the second image is visible under a second set of light wavelengths.

Abstract: The present disclosure relates to a method for calibrating a projector. In one example, the method includes receiving by a processing element light field data corresponding to a calibration image projected by a projector and captured by a light field capturing device, and modeling by a processing element one or more intrinsic properties of the projector using the light field data and the calibration image. The calibration image may be projected by the projector directly into the light field capturing device.

Abstract: The present disclosure relates to a method for calibrating a projector. The method includes projecting a test pattern onto a scene or an object within the scene and capturing the test pattern using a camera. Once the test pattern image has been captured by the camera, the method further includes estimating by a processing element a perspective projection matrix, warping the estimated projection matrix based on a non-linear distortion function, and modifying the projector to project light based on the distortion function. The present disclosure also relates to a presentation or projection system including two types of projectors for projecting an output presentation having a second image overlaid on a first image.

Abstract: A three-dimensional coordinate position of a calibration device is determined. Further, a code is emitted to an image capture device. The code indicates the three-dimensional coordinate position of the calibration device. In addition, an image of light emitted from the calibration device is captured. The light includes the code. An image capture device three-dimensional coordinate position of the calibration device is calibrated according to the real world three-dimensional coordinate position of the calibration device indicated by the code.

Abstract: A method of augmenting a human face with projected light is disclosed. The method includes determining a blend of component attributes to define visual characteristics of the human face, modifying an input image based, at least in part, on an image of the human face, wherein the modified input image defines an augmented visual characteristic of the human face, determining a present location of one or more landmarks on the human face based, at least in part, on the image of the human face, predicting a future location of the one or more landmarks, deforming a model of the human face based on the future location of the one or more landmarks, generating an augmentation image based on the deformed model and the modified input image, and transmitting for projection the augmentation image.

Abstract: A method of augmenting a target object with projected light is disclosed. The method includes determining a blend of component attributes to define visual characteristics of the target object, modifying an input image based, at least in part, on an image of the target object, wherein the modified input image defines an augmented visual characteristic of the target object, determining a present location of one or more landmarks on the target object based, at least in part, on the image of the target object, predicting a future location of the one or more landmarks, deforming a model of the target object based on the future location of the one or more landmarks, generating an augmentation image based on the deformed model and the modified input image, and transmitting for projection the augmentation image.

Abstract: A method of augmenting a target object with projected light is disclosed. The method includes determining a blend of component attributes to define visual characteristics of the target object, modifying an input image based, at least in part, on an image of the target object, wherein the modified input image defines an augmented visual characteristic of the target object, determining a present location of one or more landmarks on the target object based, at least in part, on the image of the target object, predicting a future location of the one or more landmarks, deforming a model of the target object based on the future location of the one or more landmarks, generating an augmentation image based on the deformed model and the modified input image, and transmitting for projection the augmentation image.